freeshuttercount.cam
robots.txt

Robots Exclusion Standard data for freeshuttercount.cam

Resource Scan

Scan Details

Site Domain freeshuttercount.cam
Base Domain freeshuttercount.cam
Scan Status Ok
Last Scan2025-04-11T21:14:35+00:00
Next Scan 2025-04-18T21:14:35+00:00

Last Scan

Scanned2025-04-11T21:14:35+00:00
URL https://freeshuttercount.cam/robots.txt
Domain IPs 104.21.16.176, 172.67.214.230, 2606:4700:3030::6815:10b0, 2606:4700:3030::ac43:d6e6
Response IP 104.21.16.176
Found Yes
Hash 6ee8b08b5930ec74f1e5bbd5ee7f47e7c1d4c22f8352e44e3825185f8737871c
SimHash c204c160e1a5

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /vs2/
Disallow /vs2-amp/
Disallow /view-source/
Disallow /csharp-examples-amp/
Disallow /java-api-usage-examples-amp/
Disallow /java-examples-amp/
Disallow /java-more-examples-amp/
Disallow /java-more-examples/
Disallow /python-examples-amp/
Disallow /python-more-examples-amp/
Disallow /r-examples/
Disallow /r-examples-amp/
Disallow /vs4/
Disallow /vs4-amp/
Disallow /vs3/
Disallow /vs3-amp/
Disallow /vs/
Disallow /vs-amp/
Disallow /python-how-to/
Disallow /python-how-to-amp/
Allow /wp-admin/admin-ajax.php

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dotbot

Rule Path
Disallow /