icebergpg.com
robots.txt

Robots Exclusion Standard data for icebergpg.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	icebergpg.com
Base Domain	icebergpg.com
Scan Status	Ok
Last Scan	2026-04-06T01:51:08+00:00
Next Scan	2026-04-20T01:51:08+00:00

Last Scan

Scanned	2026-04-06T01:51:08+00:00
URL	https://icebergpg.com/robots.txt
Domain IPs	2600:9000:2894:1200:16:da8b:ee40:93a1, 2600:9000:2894:1c00:16:da8b:ee40:93a1, 2600:9000:2894:1e00:16:da8b:ee40:93a1, 2600:9000:2894:2600:16:da8b:ee40:93a1, 2600:9000:2894:5e00:16:da8b:ee40:93a1, 2600:9000:2894:bc00:16:da8b:ee40:93a1, 2600:9000:2894:e200:16:da8b:ee40:93a1, 2600:9000:2894:e800:16:da8b:ee40:93a1, 3.170.229.106, 3.170.229.13, 3.170.229.34, 3.170.229.5
Response IP	3.170.229.13
Found	Yes
Hash	6e61caa3607ebfb9baceeed46e924bf77ae3126b588294cd97e7c6d1b0c7b6a9
SimHash	fc18e354a6e1

Groups

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

awariorssbot

Rule	Path
Disallow	/

Rule

Path

Disallow

awariosmartbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

cohere-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili

Rule	Path
Disallow	/

Rule

Path

Disallow

omgilibot

Rule	Path
Disallow	/

Rule

Path

Disallow

peer39_crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

peer39_crawler/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

youbot

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-image

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-news

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-video

Rule	Path
Allow	/

Rule

Path

Allow

adsense

Rule	Path
Allow	/

Rule

Path

Allow

adsbot-google

Rule	Path
Allow	/

Rule

Path

Allow

adsbot

Rule	Path
Allow	/

Rule

Path

Allow

google-inspectiontool

Rule	Path
Allow	/

Rule

Path

Allow

apis-google

Rule	Path
Allow	/

Rule

Path

Allow

feedfetcher-google

Rule	Path
Allow	/

Rule

Path

Allow

google-notebooklm

Rule	Path
Allow	/

Rule

Path

Allow

facebookexternalhit

Rule	Path
Allow	/

Rule

Path

Allow

facebot

Rule	Path
Allow	/

Rule

Path

Allow

meta-externalagent

Rule	Path
Allow	/

Rule

Path

Allow

facebook

Rule	Path
Allow	/

Rule

Path

Allow

Rule	Path
Allow	/

*

Rule	Path
Disallow	/

Rule

Path

Disallow

icebergpg.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

amazonbot

anthropic-ai

applebot-extended

awariorssbot

awariosmartbot

bytespider

ccbot

chatgpt-user

claudebot

claude-web

cohere-ai

dataforseobot

google-extended

gptbot

imagesiftbot

magpie-crawler

omgili

omgilibot

peer39_crawler

peer39_crawler/1.0

perplexitybot

youbot

googlebot

googlebot-image

googlebot-news

googlebot-video

adsense

adsbot-google

adsbot

google-inspectiontool

apis-google

feedfetcher-google

google-notebooklm

facebookexternalhit

facebot

meta-externalagent

facebook

meta

*

icebergpg.com
robots.txt