profibutor.eu
robots.txt

Robots Exclusion Standard data for profibutor.eu

Resource Scan

Scan Details

Site Domain profibutor.eu
Base Domain profibutor.eu
Scan Status Ok
Last Scan2025-07-16T02:26:51+00:00
Next Scan 2025-07-30T02:26:51+00:00

Last Scan

Scanned2025-07-16T02:26:51+00:00
URL https://profibutor.eu/robots.txt
Redirect https://www.profibutor.eu/robots.txt
Redirect Domain www.profibutor.eu
Redirect Base profibutor.eu
Domain IPs 2001:1528:114::6616, 81.0.206.125
Redirect IPs 2001:1528:114::6616, 81.0.206.125
Response IP 81.0.206.125
Found Yes
Hash d93cde06569dc1785f2c25ea6f77df9c1fe155efd0c0b26a24cff0a221aab900
SimHash c11e4562c432

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /e-basket
Disallow /e-finish
Disallow /e-send
Disallow /e-login
Disallow /e-confirm
Disallow /e-logout
Disallow /e-register
Disallow /search-engine.htm
Disallow /invoice-client

alphabot
ahrefsbot
baiduspider
blexbot
domaincrawler
dotbot
mauibot
megaindex.ru
mj12bot
ptolemaiabot
semrushbot
seekport
seekport crawler
turnitinbot
velenpublicwebcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.profibutor.eu/sitemap.xml