bidsquare.com
robots.txt

Robots Exclusion Standard data for bidsquare.com

Resource Scan

Scan Details

Site Domain bidsquare.com
Base Domain bidsquare.com
Scan Status Ok
Last Scan2024-09-13T13:23:49+00:00
Next Scan 2024-10-13T13:23:49+00:00

Last Scan

Scanned2024-09-13T13:23:49+00:00
URL https://bidsquare.com/robots.txt
Redirect https://www.bidsquare.com/robots.txt
Redirect Domain www.bidsquare.com
Redirect Base bidsquare.com
Domain IPs 104.20.58.226, 104.20.59.226, 172.67.32.160, 2606:4700:10::6814:3ae2, 2606:4700:10::6814:3be2, 2606:4700:10::ac43:20a0
Redirect IPs 104.20.58.226, 104.20.59.226, 172.67.32.160, 2606:4700:10::6814:3ae2, 2606:4700:10::6814:3be2, 2606:4700:10::ac43:20a0
Response IP 104.20.59.226
Found Yes
Hash 100134e9d787459190cfce85d5288405d41f0afbdd850ddb9d66a2b60291a0dc
SimHash 615418600e1f

Groups

*

Rule Path
Disallow /my-bidsquare
Disallow /my-account
Disallow /admin
Disallow /seller
Disallow /user
Disallow /search
Disallow /*?*category=
Disallow /category/*?*page=
Disallow /*?*search=
Disallow /*?*filters=
Disallow /*?*sort=
Disallow /*?*default=
Disallow /user/register/*
Disallow /user/register?*
Disallow /register/*
Disallow /register?*
Disallow /*?*is_ajax=
Allow /user/register

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bidsquare.com/sitemap.xml