historicbridges.org
robots.txt

Robots Exclusion Standard data for historicbridges.org

Resource Scan

Scan Details

Site Domain historicbridges.org
Base Domain historicbridges.org
Scan Status Ok
Last Scan2024-10-30T07:54:26+00:00
Next Scan 2024-11-29T07:54:26+00:00

Last Scan

Scanned2024-10-30T07:54:26+00:00
URL https://historicbridges.org/robots.txt
Domain IPs 75.119.203.128
Response IP 75.119.203.128
Found Yes
Hash 72f76de9bf3a3c42b61de824bf9a9a5f90274f54918eb1f7c5cb426210ff15f3
SimHash ca2a5039e882

Groups

hopperbot
psbot
flipboard
flipboardproxy
turnitinbot
newslookup-bot
sogou spider
fairshare.cc
baiduspider
baiduspider-video
baiduspider-image
cyberalert
cyberalert.com
cyberalert.com
ahrefsbot
genieo
ezooms
moreoverbot/5.1
moreoverbot
synthesio
rediffnewsbot
blp_bbot/0.1
blp_bbot
fr_crawler
sosospider
magpie-crawler
superfeedr bot
memonewsbot
blekkobot
vocusbot
mj12bot
spinn3r
flamingo_searchengine
grapeshot
exabot
toscrawler
maxpointcrawler
linguee bot
integromedb
mandalay
semrushbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*placeholder*.php
Disallow /temp/
Disallow /bridges/browser/tcpdf/
Disallow /sql/
Disallow /barkerpatents/
Disallow /*photosviewer.php*
Disallow /*narrative.php*
Disallow /bridges/browser/map.php*
Disallow /*.pdf*
Disallow /*.txt*
Disallow /*videos.php*
Disallow /*b_a_makemap_google.php*
Disallow /*b_a_makemap.php*
Disallow /*b_a_listings.php*
Disallow /*gallery*.php*
Disallow /*b_a_add.php*
Disallow /Resources/
Disallow /*com.sygic.aura*
Disallow /*b_a_searchsql.php*
Disallow /*b_a_resultssql.php*
Disallow /*inventory.htm*
Disallow /*b_a_locate.php*
Disallow /*b_a_random3.php*
Disallow /*b_a_random.php*
Disallow /*b_a_random_mi.php*
Disallow /*b_a_locate.php*
Disallow /*b_a_locate.php*
Disallow /*b_h_locate.php*
Disallow /*b_l_locate.php*
Disallow /*b_n_locate.php*
Disallow /*b_r_locate.php*

Warnings

  • 2 invalid lines.