bridge.us
robots.txt
Robots Exclusion Standard data for bridge.us
Resource Scan
Scan Details
| Site Domain | bridge.us |
| Base Domain | bridge.us |
| Scan Status | Ok |
| Last Scan | 2024-11-16T15:43:22+00:00 |
| Next Scan | 2024-12-16T15:43:22+00:00 |
Last Scan
| Scanned | 2024-11-16T15:43:22+00:00 |
| URL | https://bridge.us/robots.txt |
| Redirect | https://www.boundless.com/robots.txt |
| Redirect Domain | www.boundless.com |
| Redirect Base | boundless.com |
| Domain IPs | 172.66.40.183, 172.66.43.73, 2606:4700:3108::ac42:28b7, 2606:4700:3108::ac42:2b49 |
| Redirect IPs | 172.66.41.33, 172.66.42.223, 2606:4700:3108::ac42:2921, 2606:4700:3108::ac42:2adf |
| Response IP | 172.66.41.33 |
| Found | Yes |
| Hash | 2635a5ce0aa9f92bb1877296255f46efdc3980ba8384b3eb11047d04d7ae018b |
| SimHash | 524379908ee6 |
Groups
ccbot
friendlycrawler
icc-crawler
imagesiftbot
img2dataset
meta-externalagent
omgili
omgilibot
scrapy
timpibot
velenpublicwebcrawler
youbot
semrushbot
semrush
seositecheckup
siphon
sitesucker
vidiblescraper
webbandit
xenu
cognitiveseo
dataforseo.com
magpie-crawler
seobility
seostar
sitechecker.pro
serpstatbot
spyfu
webpros.com
webprosbot
dataforseobot
siteauditbot-mobile
dotbot
majestic
majestic-seo
majestic12
netlyzer
netspider
ninja
phpcrawl
pageanalyzer
pandalytics
pagegrabber
petalbot
mj12bot
deepcrawl
rogerbot
backlink-ceck
pycurl
seokicks
seokicks-robot
seolyticscrawler
seoprofiler
seostats
backlinkcrawler
backlinksextendedbot
builtwith
buzzsumo
crazywebcrawler
domaincrawler
domainstatsbot
erocrawler
extractor
extractorpro
headmasterseo
htmlparser
linkscan
linkwalker
linkbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /applications/ |
| Disallow | /vendor/ |
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.boundless.com/sitemap_index.xml |