easytoys.nl
robots.txt

Robots Exclusion Standard data for easytoys.nl

Resource Scan

Scan Details

Site Domain easytoys.nl
Base Domain easytoys.nl
Scan Status Ok
Last Scan2024-11-16T05:59:37+00:00
Next Scan 2024-12-16T05:59:37+00:00

Last Scan

Scanned2024-11-16T05:59:37+00:00
URL https://easytoys.nl/robots.txt
Redirect https://www.easytoys.nl/robots.txt
Redirect Domain www.easytoys.nl
Redirect Base easytoys.nl
Domain IPs 2600:1901:0:b5fd::80, 34.120.122.31
Redirect IPs 2600:1901:0:b5fd::80, 34.120.122.31
Response IP 34.120.122.31
Found Yes
Hash 9a9ff99d4e7c2cfc550af99abbcd5dd3d2a4385722518f63a1e5886719d8132a
SimHash b21a9273a09b

Groups

*

Rule Path
Disallow /ajax
Disallow /pdf
Disallow /afrekenenwinkelwagen/
Disallow /afrekenenwinkelwagen.html
Disallow /afrekenenadres/
Disallow /afrekenenadres.html
Disallow /afrekenenoverzicht/
Disallow /afrekenenoverzicht.html
Disallow /afrekenenbezorgen/
Disallow /afrekeneninloggen/
Disallow /afrekenenbetaalmethode/
Disallow /bestelling/
Disallow /bestelling.html
Disallow /bestelling_annuleren/
Disallow /bestelling_annuleren.html
Disallow /bestelling_error/
Disallow /bestelling_error.html
Disallow /kassa/
Disallow /kassa.html
Disallow /vieworder.html
Disallow /retourformulier.html
Disallow /bedankt.html
Disallow /zoeken.html
Disallow /recensie.html
Disallow /account/
Disallow /account-registeren/
Disallow /factuur/
Disallow /wachtwoord-vergeten/
Disallow /zoeken*
Disallow /catalogsearch*
Disallow /erotiekwinkel/
Disallow /ero/
Disallow /klantenservice/voorwaarden.html

ahrefsbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

twengabot-2.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.easytoys.nl/sitemap_index.xml