m.benaughty.com
robots.txt

Robots Exclusion Standard data for m.benaughty.com

Resource Scan

Scan Details

Site Domain m.benaughty.com
Base Domain benaughty.com
Scan Status Ok
Last Scan2025-04-02T10:03:11+00:00
Next Scan 2025-05-02T10:03:11+00:00

Last Scan

Scanned2025-04-02T10:03:11+00:00
URL https://m.benaughty.com/robots.txt
Redirect https://www.benaughty.com/robots.txt
Redirect Domain www.benaughty.com
Redirect Base benaughty.com
Domain IPs 23.52.171.216, 23.59.168.185, 2600:1413:b000:1b::17d7:709, 2600:1413:b000:1b::17d7:718
Redirect IPs 125.56.219.18, 23.32.29.91, 2600:1413:b000:1b::17d7:709, 2600:1413:b000:1b::17d7:718
Response IP 125.56.219.18
Found Yes
Hash 67fd261d7a708030782de32df89889efe97cb1b466856920873665b4b39498e7
SimHash 2c4640444ab3

Groups

*

Rule Path
Disallow /openx_proxy*
Disallow /*/autologin.php
Disallow /?inv_lp*
Disallow /?s=s
Disallow /pay/page/
Disallow /?p=*
Disallow /help.php*
Disallow /static.php*
Disallow /site/
Disallow *autologin*

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.benaughty.com/sitemap.xml