historicbridges.org
robots.txt
Robots Exclusion Standard data for historicbridges.org
Resource Scan
Scan Details
Site Domain | historicbridges.org |
Base Domain | historicbridges.org |
Scan Status | Ok |
Last Scan | 2024-10-30T07:54:26+00:00 |
Next Scan | 2024-11-29T07:54:26+00:00 |
Last Scan
Scanned | 2024-10-30T07:54:26+00:00 |
URL | https://historicbridges.org/robots.txt |
Domain IPs | 75.119.203.128 |
Response IP | 75.119.203.128 |
Found | Yes |
Hash | 72f76de9bf3a3c42b61de824bf9a9a5f90274f54918eb1f7c5cb426210ff15f3 |
SimHash | ca2a5039e882 |
Groups
hopperbot
psbot
flipboard
flipboardproxy
turnitinbot
newslookup-bot
sogou spider
fairshare.cc
baiduspider
baiduspider-video
baiduspider-image
cyberalert
cyberalert.com
cyberalert.com
ahrefsbot
genieo
ezooms
moreoverbot/5.1
moreoverbot
synthesio
rediffnewsbot
blp_bbot/0.1
blp_bbot
fr_crawler
sosospider
magpie-crawler
superfeedr bot
memonewsbot
blekkobot
vocusbot
mj12bot
spinn3r
flamingo_searchengine
grapeshot
exabot
toscrawler
maxpointcrawler
linguee bot
integromedb
mandalay
semrushbot
Rule | Path |
---|---|
Disallow | / |
googlebot
Rule | Path |
---|---|
Disallow | /*placeholder*.php |
Disallow | /temp/ |
Disallow | /bridges/browser/tcpdf/ |
Disallow | /sql/ |
Disallow | /barkerpatents/ |
Disallow | /*photosviewer.php* |
Disallow | /*narrative.php* |
Disallow | /bridges/browser/map.php* |
Disallow | /*.pdf* |
Disallow | /*.txt* |
Disallow | /*videos.php* |
Disallow | /*b_a_makemap_google.php* |
Disallow | /*b_a_makemap.php* |
Disallow | /*b_a_listings.php* |
Disallow | /*gallery*.php* |
Disallow | /*b_a_add.php* |
Disallow | /Resources/ |
Disallow | /*com.sygic.aura* |
Disallow | /*b_a_searchsql.php* |
Disallow | /*b_a_resultssql.php* |
Disallow | /*inventory.htm* |
Disallow | /*b_a_locate.php* |
Disallow | /*b_a_random3.php* |
Disallow | /*b_a_random.php* |
Disallow | /*b_a_random_mi.php* |
Disallow | /*b_a_locate.php* |
Disallow | /*b_a_locate.php* |
Disallow | /*b_h_locate.php* |
Disallow | /*b_l_locate.php* |
Disallow | /*b_n_locate.php* |
Disallow | /*b_r_locate.php* |
Warnings
- 2 invalid lines.