aha-forums.com
robots.txt

Robots Exclusion Standard data for aha-forums.com

Resource Scan

Scan Details

Site Domain aha-forums.com
Base Domain aha-forums.com
Scan Status Ok
Last Scan2024-09-24T12:53:53+00:00
Next Scan 2024-10-24T12:53:53+00:00

Last Scan

Scanned2024-09-24T12:53:53+00:00
URL https://aha-forums.com/robots.txt
Domain IPs 67.227.156.150
Response IP 67.227.156.150
Found Yes
Hash 7706e1a862f3ee7c8807a1c5de31e317578476108f0bd65bb53345cad1040340
SimHash 29081ad641b6

Groups

googlebot-image

Rule Path
Disallow /REVIEWSITE/

yandeximages

Rule Path
Disallow /REVIEWSITE/

msnbot-mm

Rule Path
Disallow /REVIEWSITE/

googlebot-mobile

Rule Path
Allow /REVIEWSITE/*wap
Disallow /REVIEWSITE/

yandeximageresizer

Rule Path
Allow /REVIEWSITE/*wap
Disallow /REVIEWSITE/

mediapartners-google

Rule Path
Allow /REVIEWSITE/

*

Rule Path
Allow /REVIEWSITE/$
Allow /REVIEWSITE/*forum$
Allow /REVIEWSITE/*page*page
Allow /REVIEWSITE/*.xml
Allow /REVIEWSITE/*sitemap
Disallow /attachments/
Disallow /avatars/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /*msg
Disallow /*profile
Disallow /*help
Disallow /*search
Disallow /*mlist
Disallow /*sort
Disallow /*recent
Disallow /*register
Disallow /*groups
Disallow /*stats
Disallow /*unread
Disallow /*topicseen
Disallow /*showtopic
Disallow /*prev_next
Disallow /*imode
Disallow /*wap
Disallow /*all
Allow /REVIEWSITE/*action
Disallow /REVIEWSITE/*PHPSESSID

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://aha-forums.com/REVIEWSITE/sitemap.xml