avistamembranesolutions.com
robots.txt

Robots Exclusion Standard data for avistamembranesolutions.com

Resource Scan

Scan Details

Site Domain avistamembranesolutions.com
Base Domain avistamembranesolutions.com
Scan Status Ok
Last Scan2025-11-19T11:37:36+00:00
Next Scan 2025-12-19T11:37:36+00:00

Last Scan

Scanned2025-11-19T11:37:36+00:00
URL https://avistamembranesolutions.com/robots.txt
Domain IPs 104.26.6.229, 104.26.7.229, 172.67.71.156, 2606:4700:20::681a:6e5, 2606:4700:20::681a:7e5, 2606:4700:20::ac43:479c
Response IP 172.67.71.156
Found Yes
Hash 2f3fe6e2c7f6fc13cf7970d5a2cd818423fafe321effe96474323e00bfc996d7
SimHash 6900580443b0

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /tag/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://avistamembranesolutions.com/sitemap_index.xml

Warnings

  • 1 invalid line.