aworkinglibrary.com
robots.txt

Robots Exclusion Standard data for aworkinglibrary.com

Resource Scan

Scan Details

Site Domain aworkinglibrary.com
Base Domain aworkinglibrary.com
Scan Status Ok
Last Scan2024-10-25T07:27:09+00:00
Next Scan 2024-11-24T07:27:09+00:00

Last Scan

Scanned2024-10-25T07:27:09+00:00
URL https://aworkinglibrary.com/robots.txt
Domain IPs 13.228.199.255, 13.251.96.10
Response IP 18.139.194.139
Found Yes
Hash 4c4302e4b2c7615f8f76599746caff595612e35ec0f5cec99ddf92352c176cf5
SimHash 3af149608233

Groups

*

Rule Path
Disallow /error.html
Disallow /subscribed/
Disallow /unsubscribed/
Disallow /maintenance.html

applebot-extended
ccbot
chatgpt-user
gptbot
google-extended
omgilibot
facebookbot
adsbot-google

Rule Path
Disallow /

Comments

  • hide irrelevant pages
  • fuck the bots