naughtythai.com
robots.txt

Robots Exclusion Standard data for naughtythai.com

Resource Scan

Scan Details

Site Domain naughtythai.com
Base Domain naughtythai.com
Scan Status Ok
Last Scan2024-10-28T06:43:38+00:00
Next Scan 2024-11-27T06:43:38+00:00

Last Scan

Scanned2024-10-28T06:43:38+00:00
URL https://naughtythai.com/robots.txt
Redirect https://www.naughtythai.com/robots.txt
Redirect Domain www.naughtythai.com
Redirect Base naughtythai.com
Domain IPs 157.245.125.69, 165.22.145.229
Redirect IPs 23.215.7.16, 23.215.7.17, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:711
Response IP 104.88.71.35
Found Yes
Hash ccd71be72e30ee266a25997e343dc01de4eeacc5b4850a0556af4499cc42f346
SimHash 79154c40cf33

Groups

*

Rule Path
Disallow *autologin*

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.naughtythai.com/sitemap.xml