goingbirding.co.uk
robots.txt

Robots Exclusion Standard data for goingbirding.co.uk

Resource Scan

Scan Details

Site Domain goingbirding.co.uk
Base Domain goingbirding.co.uk
Scan Status Ok
Last Scan2024-10-01T12:56:09+00:00
Next Scan 2024-10-08T12:56:09+00:00

Last Scan

Scanned2024-10-01T12:56:09+00:00
URL https://goingbirding.co.uk/robots.txt
Domain IPs 92.205.227.171
Response IP 92.205.227.171
Found Yes
Hash 128be1aab591e05c1600989fab907b5896fde2151b5bfb923da286156ecf68af
SimHash 9216503adea1

Groups

*

Rule Path
Disallow /500.asp
Disallow /asp2netbridge.asp
Disallow /keepalive.asp
Disallow */cache/
Disallow */data/
Disallow */photos/
Disallow */webadmin/
Disallow */brcreport.asp
Disallow */brcreport2.asp
Disallow */error.aspx
Disallow */getnews.asp
Disallow */message.asp
Disallow */offline.html
Disallow */sendnotification.aspx
Disallow */sendtweet.aspx
Disallow */wip.aspx
Disallow */birdnews.asp?*sort=*
Disallow */birdnews.asp?*status_id=*

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

test-bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /