hab-metal.com
robots.txt

Robots Exclusion Standard data for hab-metal.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	hab-metal.com
Base Domain	hab-metal.com
Scan Status	Ok
Last Scan	2025-03-21T06:54:56+00:00
Next Scan	2025-04-20T06:54:56+00:00

Last Scan

Scanned	2025-03-21T06:54:56+00:00
URL	https://hab-metal.com/robots.txt
Redirect	https://www.hab-metal.com/robots.txt
Redirect Domain	www.hab-metal.com
Redirect Base	hab-metal.com
Domain IPs	104.21.4.92, 172.67.131.228, 2606:4700:3034::6815:45c, 2606:4700:3035::ac43:83e4
Redirect IPs	104.21.4.92, 172.67.131.228, 2606:4700:3034::6815:45c, 2606:4700:3035::ac43:83e4
Response IP	172.67.131.228
Found	Yes
Hash	9327c5d01514606643473e3407718d57737d86102d7706a84f26eb7d0a8eff90
SimHash	121447708112

Groups

*

Rule	Path
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

sistrix

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey spider

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ncbot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

meanpathbot

Rule	Path
Disallow	/

Rule

Path

Disallow

pagesinventory

Rule	Path
Disallow	/

Rule

Path

Disallow

aboundexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

linkdexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-12

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-seo

Rule	Path
Disallow	/

Rule

Path

Disallow

dsearch

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12

Rule	Path
Disallow	/

Rule

Path

Disallow

blekkobot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

jamesbot

Rule	Path
Disallow	/

Rule

Path

Disallow

tineye

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstat

Rule	Path
Disallow	/

Rule

Path

Disallow

spyfu

Rule	Path
Disallow	/

Rule

Path

Disallow

prlog

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.hab-metal.com/sitemap.xml
sitemap	https://www.hab-metal.com/sitemap.rss

Field

Value

sitemap

https://www.hab-metal.com/sitemap.xml

sitemap

https://www.hab-metal.com/sitemap.rss

hab-metal.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

ahrefsbot

mj12bot

rogerbot

semrushbot

ia_archiver

scoutjet

sistrix

searchmetricsbot

seokicks-robot

lipperhey spider

exabot

ncbot

backlinkcrawler

archive.org_bot

meanpathbot

pagesinventory

aboundexbot

spbot

linkdexbot

gigabot

dotbot

nutch

blexbot

ezooms

majestic-12

majestic-seo

dsearch

mj12

blekkobot

nerdybot

jamesbot

tineye

baiduspider

serpstat

spyfu

prlog

Other Records

hab-metal.com
robots.txt