Robots

library 0.10.1 ·ruby

✓ verified Jun 19, 2026

networking utility

Parses robots.txt files to determine allowed and disallowed paths for web crawlers.

Resources

docswww.rubydoc.info/gems/robots/ ↗

githubgithub.com/fizx/robots ↗

API endpoints

full doc /v1/registry/robots

install /v1/registry/robots/install