Log In Sign Up

o-ring-stocks.com
robots.txt

Robots Exclusion Standard data for o-ring-stocks.com

Resource Scan

Scan Details

Site Domain o-ring-stocks.com
Base Domain o-ring-stocks.com
Scan Status Ok
Last Scan2024-09-26T01:40:24+00:00
Next Scan 2024-10-26T01:40:24+00:00

Last Scan

Scanned2024-09-26T01:40:24+00:00
URL https://o-ring-stocks.com/robots.txt
Redirect https://www.o-ring-stocks.com/robots.txt
Redirect Domain www.o-ring-stocks.com
Redirect Base o-ring-stocks.com
Domain IPs 87.233.219.34
Redirect IPs 87.233.219.34
Response IP 87.233.219.34
Found Yes
Hash 5388adf3725ac9219ca3a4817c6da36c993ee7262fbcbff2e775e8718b93d34b
SimHash b5db59dbce3b

Groups

*

Rule Path
Disallow /checkout/
Disallow /order/
Disallow /loggedin/
Disallow /search/
Disallow *ajax.php
Disallow /upload/scripts/
Disallow /specifications-pdf/
Disallow /food-checkpostalcode
Disallow *?cat_id=*
Disallow *?question*
Disallow *spec%3D
Disallow *spec%5B
Disallow *openSoftCompare
Disallow *material%3D
Disallow *brand%3D
Disallow *model%3D
Disallow *length%3D
Disallow *color%3D
Disallow *type%3D
Disallow *s%3D
Disallow *p%3D
Disallow *authorId%3D

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

newspaper/0.2.8

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

israbot

Rule Path
Disallow /

python/3.9 aiohttp/3.8.1

Rule Path
Disallow /

qwantify/2.4w

Rule Path
Disallow /

proximic

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

scrapy/2.5.0

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.o-ring-stocks.com/sitemap.xml
Back to top