againfaster.eu
robots.txt

Robots Exclusion Standard data for againfaster.eu

Resource Scan

Scan Details

Site Domain againfaster.eu
Base Domain againfaster.eu
Scan Status Ok
Last Scan2026-02-15T11:06:58+00:00
Next Scan 2026-03-17T11:06:58+00:00

Last Scan

Scanned2026-02-15T11:06:58+00:00
URL https://againfaster.eu/robots.txt
Domain IPs 104.26.10.81, 104.26.11.81, 172.67.70.223, 2606:4700:20::681a:a51, 2606:4700:20::681a:b51, 2606:4700:20::ac43:46df
Response IP 172.67.70.223
Found Yes
Hash 7c7d50c395ce525ec8336f3d3fa74f38a3a5c8530638d8d5b8bf0ebc6c2a8479
SimHash 4d34dc5b6e51

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /search/*
Disallow /*SID%3D
Allow /*p%3D

Other Records

Field Value
sitemap https://againfaster.eu/sitemap.xml
sitemap https://againfaster.eu/sitemap_fr.xml
sitemap https://againfaster.eu/sitemap_de.xml
sitemap https://againfaster.eu/sitemap_it.xml
sitemap https://againfaster.eu/sitrmap_es.xml

Comments

  • Crawlers Setup