shemale99.com
robots.txt

Robots Exclusion Standard data for shemale99.com

Resource Scan

Scan Details

Site Domain shemale99.com
Base Domain shemale99.com
Scan Status Ok
Last Scan2024-11-10T03:29:08+00:00
Next Scan 2024-12-10T03:29:08+00:00

Last Scan

Scanned2024-11-10T03:29:08+00:00
URL https://shemale99.com/robots.txt
Domain IPs 104.21.23.74, 172.67.209.200, 2606:4700:3036::6815:174a, 2606:4700:3037::ac43:d1c8
Response IP 172.67.209.200
Found Yes
Hash 6847f152eda1f401dd2c0e6194f86dbc7f8c417e491c946d43c90855dc0d40dc
SimHash 803cc0a2e99b

Groups

*

Rule Path
Disallow

ia_archiver
ia_archiver-web.archive.org
mj12bot
ahrefsbot
seekport crawler
semrushbot
amazonbot
gptbot
dotbot
friendly_crawler
imagesiftbot

Rule Path
Disallow /