radio-locator.com
robots.txt

Robots Exclusion Standard data for radio-locator.com

Resource Scan

Scan Details

Site Domain radio-locator.com
Base Domain radio-locator.com
Scan Status Ok
Last Scan2024-09-27T07:50:53+00:00
Next Scan 2024-10-04T07:50:53+00:00

Last Scan

Scanned2024-09-27T07:50:53+00:00
URL https://radio-locator.com/robots.txt
Domain IPs 192.34.82.186
Response IP 192.34.82.186
Found Yes
Hash 31ae32c7e4288261a420ee7bea2d023a64fb82b3f7d23c06784cd767f4662e16
SimHash 105448424f13

Groups

femtosearchbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /cgi-bin/login
Disallow /cgi-bin/submit
Disallow /pats
Allow /

googlebot

Rule Path
Disallow /cgi-bin/login
Disallow /cgi-bin/submit
Disallow /pats
Allow /

*

Rule Path
Disallow /cgi-bin/adclick
Disallow /cgi-bin/login
Disallow /cgi-bin/pat
Disallow /cgi-bin/patg
Disallow /cgi-bin/submit
Disallow /cgi-bin/locate
Disallow /cgi-bin/vacant
Disallow /cgi-bin/url
Disallow /info
Disallow /pats

Other Records

Field Value
crawl-delay 300

Comments

  • robots.txt for radio-locator.com