sexpaysitecentral.net
robots.txt

Robots Exclusion Standard data for sexpaysitecentral.net

Resource Scan

Scan Details

Site Domain sexpaysitecentral.net
Base Domain sexpaysitecentral.net
Scan Status Ok
Last Scan6/8/2025, 5:09:04 AM
Next Scan 7/8/2025, 5:09:04 AM

Last Scan

Scanned6/8/2025, 5:09:04 AM
URL https://sexpaysitecentral.net/robots.txt
Redirect https://www.sexpaysitecentral.net/robots.txt
Redirect Domain www.sexpaysitecentral.net
Redirect Base sexpaysitecentral.net
Domain IPs 104.21.22.188, 172.67.206.161, 2606:4700:3031::ac43:cea1, 2606:4700:3037::6815:16bc
Redirect IPs 104.21.22.188, 172.67.206.161, 2606:4700:3031::ac43:cea1, 2606:4700:3037::6815:16bc
Response IP 172.67.206.161
Found Yes
Hash c10d59b20ac324d7667db7be8b6d071bc28b6ea60807778b47668e26b85e4c53
SimHash 7d1e5054ee99

Groups

*

Rule Path
Disallow /admin/
Disallow /cgi-bin/
Disallow /tmp/

Other Records

Field Value
crawl-delay 30

mediapartners-google
semrushbot
semrushbot-sa
yandexbot
mj12bot
ahrefsbot
bingbot
blexbot
dotbot
uptimerobot
dnyzbot
baiduspider
bubing
seznambot
petalbot
orbbot
neevabot
zoominfobot
dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sexpaysitecentral.net/sitemap.xml