vifib.com
robots.txt

Robots Exclusion Standard data for vifib.com

Resource Scan

Scan Details

Site Domain vifib.com
Base Domain vifib.com
Scan Status Ok
Last Scan2025-05-27T16:23:22+00:00
Next Scan 2025-06-26T16:23:22+00:00

Last Scan

Scanned2025-05-27T16:23:22+00:00
URL https://vifib.com/robots.txt
Domain IPs 212.129.18.209, 46.4.4.145
Response IP 212.129.18.209
Found Yes
Hash 845c591662169d20d2b485570a1290a54c37b3a31244d9e7330feba8240925ac
SimHash d10d0842ba18

Groups

scrapy

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

simplecrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

*

Rule Path
Disallow /test_result_module/
Disallow /web_site_module/

Other Records

Field Value
sitemap https://vifib.com/WebSite_viewSiteMapAsXML
sitemap https://vifib.com/fr/WebSite_viewSiteMapAsXML
sitemap https://vifib.com/zh/WebSite_viewSiteMapAsXML