bbwtodate.com
robots.txt

Robots Exclusion Standard data for bbwtodate.com

Resource Scan

Scan Details

Site Domain bbwtodate.com
Base Domain bbwtodate.com
Scan Status Ok
Last Scan2024-06-14T21:33:20+00:00
Next Scan 2024-07-14T21:33:20+00:00

Last Scan

Scanned2024-06-14T21:33:20+00:00
URL https://bbwtodate.com/robots.txt
Redirect https://www.bbwtodate.com/robots.txt
Redirect Domain www.bbwtodate.com
Redirect Base bbwtodate.com
Domain IPs 142.93.74.86, 64.225.33.137
Redirect IPs 23.52.171.66, 23.59.168.170, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:714
Response IP 23.59.168.170
Found Yes
Hash 4f3892fb3343e70b5f220039a8a18ec20877fde0af00cdb117f4a1840f14820b
SimHash 28154840cb33

Groups

*

Rule Path
Disallow *autologin*

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.bbwtodate.com/sitemap.xml