swingerchatcity.com
robots.txt

Robots Exclusion Standard data for swingerchatcity.com

Resource Scan

Scan Details

Site Domain swingerchatcity.com
Base Domain swingerchatcity.com
Scan Status Ok
Last Scan2025-09-19T18:25:12+00:00
Next Scan 2025-10-19T18:25:12+00:00

Last Scan

Scanned2025-09-19T18:25:12+00:00
URL https://swingerchatcity.com/robots.txt
Domain IPs 104.21.37.69, 172.67.205.71, 2606:4700:3031::6815:2545, 2606:4700:3031::ac43:cd47
Response IP 104.21.37.69
Found Yes
Hash 27a30c912c75347f6f4f3c7977d5416bfb1555c3926269187f16d8e475c995dd
SimHash d21e51506880

Groups

*

Rule Path
Disallow /private/
Disallow /test/
Disallow /profile/
Disallow /search/
Disallow /support/
Disallow /contact/
Disallow /inbox/
Disallow /login/
Disallow /register/
Disallow /pages/
Disallow /faq/
Disallow /set-display/
Disallow /*?h=*

Other Records

Field Value
crawl-delay 10

amazonbot
semrushbot
ahrefsbot
mj12bot
dotbot
megaindex.ru
megaindex.com
panscient
panscient.com
serpstatbot
blexbot
inktomi slurp
nimbostratus
seznambot
brands-bot-logo
brands-bot
bbot
petalbot
zoominfobot
seokicks
mojeekbot
mauibot
mtrobot
linguee
indeedbot
aasa-bot
tkbot
dataforseobot
bl.uk_lddc_bot
paracrawl
gptbot
chatgpt-user
claudebot
anthropic-ai
claude-web
google-extended
ccbot
bytespider
meta-externalagent

Rule Path
Disallow /