advanceautoparts.jobs
robots.txt

Robots Exclusion Standard data for advanceautoparts.jobs

Resource Scan

Scan Details

Site Domain advanceautoparts.jobs
Base Domain advanceautoparts.jobs
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-04T20:40:19+00:00
Next Scan 2024-11-02T20:40:19+00:00

Last Successful Scan

Scanned2023-09-17T19:49:51+00:00
URL https://www.advanceautoparts.jobs/robots.txt
Domain IPs 13.33.88.128, 13.33.88.129, 13.33.88.33, 13.33.88.45, 2600:9000:223b:1200:1a:6a22:8800:93a1, 2600:9000:223b:1400:1a:6a22:8800:93a1, 2600:9000:223b:600:1a:6a22:8800:93a1, 2600:9000:223b:8000:1a:6a22:8800:93a1, 2600:9000:223b:9600:1a:6a22:8800:93a1, 2600:9000:223b:b000:1a:6a22:8800:93a1, 2600:9000:223b:cc00:1a:6a22:8800:93a1, 2600:9000:223b:de00:1a:6a22:8800:93a1
Response IP 18.161.111.32
Found Yes
Hash 0604b07fa32cc53766005a5f28871c7ff437c8b6bdd7be166e9e97b1dbfa014e
SimHash 6e6d9a60c273

Groups

jooblebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

jobrapido

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

jobbot

Rule Path
Disallow /

jobcrawlerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

wijubot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow
Disallow /admin

Other Records

Field Value
sitemap https://www.advanceautoparts.jobs/sitemap