bergentaxi.no
robots.txt

Robots Exclusion Standard data for bergentaxi.no

Resource Scan

Scan Details

Site Domain bergentaxi.no
Base Domain bergentaxi.no
Scan Status Ok
Last Scan2024-10-06T03:52:31+00:00
Next Scan 2024-11-05T03:52:31+00:00

Last Scan

Scanned2024-10-06T03:52:31+00:00
URL https://bergentaxi.no/robots.txt
Redirect https://www.bergentaxi.no/robots.txt
Redirect Domain www.bergentaxi.no
Redirect Base bergentaxi.no
Domain IPs 162.159.135.42
Redirect IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash e62862829d96cbea88208ca9639bc04879ddc205b7b309f3f218bbc3418845a4
SimHash 4900c84023b1

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/