baritoday.it
robots.txt

Robots Exclusion Standard data for baritoday.it

Resource Scan

Scan Details

Site Domain baritoday.it
Base Domain baritoday.it
Scan Status Ok
Last Scan2024-06-15T11:31:52+00:00
Next Scan 2024-06-22T11:31:52+00:00

Last Scan

Scanned2024-06-15T11:31:52+00:00
URL https://baritoday.it/robots.txt
Redirect https://www.baritoday.it/robots.txt
Redirect Domain www.baritoday.it
Redirect Base baritoday.it
Domain IPs 109.168.105.232, 109.168.105.233, 195.231.59.141, 46.254.34.118, 52.144.69.196, 52.144.69.197, 95.110.224.15
Redirect IPs 109.168.105.232, 109.168.105.233, 195.231.59.141, 46.254.34.118, 52.144.69.196, 52.144.69.197, 95.110.224.15
Response IP 52.144.69.196
Found Yes
Hash 05924d43900b12dc39850e415ffa05d57503145f3e6151083c89a3682f0ae450
SimHash 0fc9ce0247d0

Groups

*

Rule Path
Allow /
Disallow /~vda/
Disallow /~shared/do/
Disallow /~shared/cgi-bin/
Disallow /~do/
Disallow /~cgi-bin/
Disallow /do/
Disallow /cgi-bin/
Disallow /~test/
Disallow /~api/
Disallow /~ajax/
Disallow /~otp/
Disallow /~pixel/
Disallow /~empty/
Disallow /captcha/
Disallow /form/
Disallow /signup/
Disallow /commento/
Disallow /user/login/
Disallow /user/logout/
Disallow /user/sso/
Disallow /user/oauth/
Disallow /user/activate/
Disallow /user/reset/
Disallow /user/delete/
Disallow /user/unsubscribe/
Disallow /user/contents/
Disallow /user/news/
Disallow /user/relation/
Disallow /user/subscription/
Disallow /user/edit/
Disallow /user/self/
Disallow /~shared/styles/
Disallow /styles/
Disallow /~shared/scripts/
Disallow /scripts/
Disallow /medias/
Disallow /uploads/
Disallow /sf/
Allow /~shared/do/api/google/
Allow /~shared/do/api/google-newsstand/
Allow /~shared/do/api/amazon/
Allow /~shared/do/api/facebook/
Allow /~shared/do/api/samsung/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.baritoday.it/sitemaps/sitemap.xml
sitemap https://www.baritoday.it/sitemaps/sitemap_news.xml

Warnings

  • `host` is not a known field.