uri.com
robots.txt

Robots Exclusion Standard data for uri.com

Resource Scan

Scan Details

Site Domain uri.com
Base Domain uri.com
Scan Status Ok
Last Scan2024-11-14T04:32:35+00:00
Next Scan 2024-12-14T04:32:35+00:00

Last Scan

Scanned2024-11-14T04:32:35+00:00
URL https://uri.com/robots.txt
Redirect https://www.uri.com/robots.txt
Redirect Domain www.uri.com
Redirect Base uri.com
Domain IPs 8.192.40.65
Redirect IPs 8.192.40.65
Response IP 8.192.40.65
Found Yes
Hash 2de671df18c87d751c35a5e18a37d2f9db5a05b956147d76abc6fe8cc0dbcc9d
SimHash 6d17dc754411

Groups

pallbot

Rule Path
Disallow

adsbot-google
googlebot
mediapartners-google
googlebot-image/1.0
googlebot-video/1.0

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

gsa-crawler

Rule Path
Disallow

yandexbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.uri.com/sitemap-StandardDataFeed