bostontribute.com
robots.txt

Robots Exclusion Standard data for bostontribute.com

Resource Scan

Scan Details

Site Domain bostontribute.com
Base Domain bostontribute.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-28T05:48:23+00:00
Next Scan 2026-02-26T05:48:23+00:00

Last Successful Scan

Scanned2024-04-14T22:55:36+00:00
URL https://bostontribute.com/robots.txt
Redirect https://infoberita.org/robots.txt
Redirect Domain infoberita.org
Redirect Base infoberita.org
Domain IPs 104.21.30.104, 172.67.172.191, 2606:4700:3033::ac43:acbf, 2606:4700:3035::6815:1e68
Redirect IPs 104.21.32.164, 172.67.152.225, 2606:4700:3031::ac43:98e1, 2606:4700:3033::6815:20a4
Response IP 104.21.32.164
Found Yes
Hash 962f059eb8a3fcde21272f3bc8d2a7063cc595d4e6ab0f57065cbae4eebd680e
SimHash 69200a22cb92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://infoberita.org/sitemap.xml
sitemap https://infoberita.org/sitemap.rss