backpageclassifieds.com
robots.txt

Robots Exclusion Standard data for backpageclassifieds.com

Resource Scan

Scan Details

Site Domain backpageclassifieds.com
Base Domain backpageclassifieds.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-07-04T12:10:11+00:00
Next Scan 2024-10-02T12:10:11+00:00

Last Successful Scan

Scanned2024-03-07T11:41:30+00:00
URL https://backpageclassifieds.com/robots.txt
Domain IPs 104.26.2.131, 104.26.3.131, 172.67.75.158, 2606:4700:20::681a:283, 2606:4700:20::681a:383, 2606:4700:20::ac43:4b9e
Response IP 104.26.3.131
Found Yes
Hash 26b1e83bd8c6b0d868ccf343aae825d25d52c57299a39c3a1ce4b364ee5ff761
SimHash e94b50444d93

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://backpage.au/sitemap.xml

Comments

  • robots.txt generated by smallseotools.com