anicetits.com
robots.txt

Robots Exclusion Standard data for anicetits.com

Resource Scan

Scan Details

Site Domain anicetits.com
Base Domain anicetits.com
Scan Status Ok
Last Scan2024-05-17T11:38:02+00:00
Next Scan 2024-06-16T11:38:02+00:00

Last Scan

Scanned2024-05-17T11:38:02+00:00
URL https://anicetits.com/robots.txt
Domain IPs 104.21.19.147, 172.67.186.131, 2606:4700:3033::6815:1393, 2606:4700:3034::ac43:ba83
Response IP 104.21.19.147
Found Yes
Hash fe8ac5de2ec2deb50a450698b6c85ae32f01d692b1b347dc1f9fab8da92dac2b
SimHash 4114d805c773

Groups

*

Rule Path
Allow /
Disallow /stats/
Disallow /cgi-bin/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10