Spatie Robots.txt

JSON →
library 2.5.4 ·php
verified Jun 19, 2026

Determine if a page may be crawled from robots.txt and robots meta tags.