wepc.com
robots.txt

Robots Exclusion Standard data for wepc.com

Resource Scan

Scan Details

Site Domain wepc.com
Base Domain wepc.com
Scan Status Ok
Last Scan2024-11-16T10:14:00+00:00
Next Scan 2024-11-23T10:14:00+00:00

Last Scan

Scanned2024-11-16T10:14:00+00:00
URL https://wepc.com/robots.txt
Redirect https://www.wepc.com/robots.txt
Redirect Domain www.wepc.com
Redirect Base wepc.com
Domain IPs 104.26.10.74, 104.26.11.74, 172.67.74.158, 2606:4700:20::681a:a4a, 2606:4700:20::681a:b4a, 2606:4700:20::ac43:4a9e
Redirect IPs 104.26.10.74, 104.26.11.74, 172.67.74.158, 2606:4700:20::681a:a4a, 2606:4700:20::681a:b4a, 2606:4700:20::ac43:4a9e
Response IP 172.67.74.158
Found Yes
Hash ee65ee967427379ff012213c6b02bcc67eb95d43be0cd5377f8296c2da04701e
SimHash 65058832e761

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /order/
Disallow /product/
Disallow /brands/
Disallow /deals-offers/
Disallow /vgs/
Disallow /team/
Disallow /aggregate
Disallow /attachment/
Disallow /cdn-cgi/
Disallow /*?ignorenitro=*
Disallow /feed/atom/

ahrefssiteaudit

Rule Path
Allow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wepc.com/sitemap_index.xml