milfstate.com
robots.txt

Robots Exclusion Standard data for milfstate.com

Resource Scan

Scan Details

Site Domain milfstate.com
Base Domain milfstate.com
Scan Status Ok
Last Scan2025-03-29T05:11:10+00:00
Next Scan 2025-04-28T05:11:10+00:00

Last Scan

Scanned2025-03-29T05:11:10+00:00
URL https://milfstate.com/robots.txt
Domain IPs 104.21.25.30, 172.67.222.17, 2606:4700:3032::ac43:de11, 2606:4700:3036::6815:191e
Response IP 172.67.222.17
Found Yes
Hash 771c5943cb2c89076cbc21bf8c35430e5030971c8209ec62f53b079aa6235c50
SimHash 461554016396

Groups

*

Rule Path
Disallow /search/
Disallow /info/
Disallow /ai/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3