keywords:

robotstxt

found 12 packages in 16ms

generate-robotstxt399.9kMIT8.0.3

Awesome generator robots.txt

itgalaxyabout 3 years agorobotstxt, robots.txt, generate, robots-txt

astro-robots-txt59.1kMIT1.0.0

Generate a robots.txt for Astro

alextimabout 2 years agoastro-integration, astro, astro-component, seo

robotstxt-webpack-plugin55.3kMIT8.0.0

A webpack plugin to output a robots.txt file

itgalaxyabout 3 years agorobots.txt, robots, robotstxt, generate

robots-txt-parser9.1kMIT2.0.3

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

ChrisAkroydabout 3 years agorobots, txt, robots.txt, parser

robots6970.10.1

Parser for robots.txt

ekalininabout 3 years agorobots.txt, robotstxt, parser

‹
1
2
3
›

Packages

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

Lodash modular utilities.

modules, stdlib, util

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const