keywords:

robots-txt

found 9 packages in 2ms

generate-robotstxt399.9kMIT8.0.3

Awesome generator robots.txt

itgalaxyabout 3 years agorobotstxt, robots.txt, generate, robots-txt

astro-robots-txt59.1kMIT1.0.0

Generate a robots.txt for Astro

alextimabout 2 years agoastro-integration, astro, astro-component, seo

robotstxt-webpack-plugin55.3kMIT8.0.0

A webpack plugin to output a robots.txt file

itgalaxyabout 3 years agorobots.txt, robots, robotstxt, generate

@itsmatteomanf/astro-robots-txt274MIT0.2.0

Generate a robots.txt file for your Astro site

itsmatteomanf9 months agoastro-integration, astro-component, withastro, astro

parse-robots73MIT3.2.0

Promise based parser for robots.txt files.

ArcaneDigitalover 3 years agocrawl, web, robots.txt, seo

‹
1
2
›

Packages

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

Lodash modular utilities.

modules, stdlib, util

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const