Log In Sign Up

pb4.in
robots.txt

Robots Exclusion Standard data for pb4.in

Resource Scan

Scan Details

Site Domain pb4.in
Base Domain pb4.in
Scan Status Ok
Last Scan2024-10-09T08:01:13+00:00
Next Scan 2024-10-16T08:01:13+00:00

Last Scan

Scanned2024-10-09T08:01:13+00:00
URL https://pb4.in/robots.txt
Redirect https://www.pricebefore.com/robots.txt
Redirect Domain www.pricebefore.com
Redirect Base pricebefore.com
Domain IPs 2a02:4780:84:3f65:16f6:6104:b28c:ea82, 84.32.84.106
Redirect IPs 104.21.53.39, 172.67.208.187, 2606:4700:3033::ac43:d0bb, 2606:4700:3035::6815:3527
Response IP 172.67.208.187
Found Yes
Hash 919350fde5229b38ea221b30ca39c01c695776eafd37572823a2fb549cdca566
SimHash c8175c12cc9b

Groups

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /redirect/
Disallow /search/
Disallow /category/filters/
Disallow /*.html$
Back to top

Other Records

Field Value
sitemap https://www.pricebefore.com/sitemap.xml
Back to top