advfit.com
robots.txt

Robots Exclusion Standard data for advfit.com

Resource Scan

Scan Details

Site Domain advfit.com
Base Domain advfit.com
Scan Status Ok
Last Scan2026-01-25T09:02:51+00:00
Next Scan 2026-02-24T09:02:51+00:00

Last Scan

Scanned2026-01-25T09:02:51+00:00
URL https://advfit.com/robots.txt
Redirect https://www.advfit.com/robots.txt
Redirect Domain www.advfit.com
Redirect Base advfit.com
Domain IPs 199.34.228.55
Redirect IPs 199.34.228.55
Response IP 199.34.228.55
Found Yes
Hash b878742a7c66335ca3150f570e3abfc17950c113434678ea91d59f8a4ef90ad6
SimHash 1a04d07caed3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /sensors.html
Disallow /connectors.html
Disallow /wire--cable.html
Disallow /optoelectronics.html
Disallow /electromechanical.html
Disallow /power.html
Disallow /embedded-solution.html
Disallow /tools--supplies.html

Other Records

Field Value
sitemap https://www.advfit.com/sitemap.xml