Log In Sign Up

sirvis.it
robots.txt

Robots Exclusion Standard data for sirvis.it

Resource Scan

Scan Details

Site Domain sirvis.it
Base Domain sirvis.it
Scan Status Ok
Last Scan2025-11-06T16:25:11+00:00
Next Scan 2025-11-20T16:25:11+00:00

Last Scan

Scanned2025-11-06T16:25:11+00:00
URL https://sirvis.it/robots.txt
Redirect https://www.sirvis.it/robots.txt
Redirect Domain www.sirvis.it
Redirect Base sirvis.it
Domain IPs 13.69.87.135
Redirect IPs 2.17.106.134, 2.17.106.143, 2600:1413:b000:1e::17d1:2e56, 2600:1413:b000:1e::17d1:2e5e
Response IP 23.45.207.168
Found Yes
Hash a7971a39802b7cd02ce492fc8498eadcd8c1fc9f25feff560df97860e952de68
SimHash 6c705f1fcde8

Groups

*

Rule Path
Disallow /cart
Disallow /checkout
Disallow /my-account

Other Records

Field Value Comment
crawl-delay 10 10 seconds between page requests

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

*

Rule Path
Disallow sirvis.c4oemlbtqr-ccbmanage2-s1-public.model-t.cc.commerce.ondemand.com/
Disallow sirvis-bg.c4oemlbtqr-ccbmanage2-s1-public.model-t.cc.commerce.ondemand.com/
Disallow sirvis-rs.c4oemlbtqr-ccbmanage2-s1-public.model-t.cc.commerce.ondemand.com/
Disallow sirvis-at.c4oemlbtqr-ccbmanage2-s1-public.model-t.cc.commerce.ondemand.com/
Back to top

Other Records

Field Value
sitemap /sitemap.xml
Back to top

Comments

  • For all robots
  • Block access to specific groups of pages
  • Allow search crawlers to discover the sitemap
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Block all for s1 hosts
Back to top

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.
Back to top