generalmanual.com
robots.txt

Robots Exclusion Standard data for generalmanual.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	generalmanual.com
Base Domain	generalmanual.com
Scan Status	Ok
Last Scan	2024-09-30T08:55:02+00:00
Next Scan	2024-10-07T08:55:02+00:00

Last Scan

Scanned	2024-09-30T08:55:02+00:00
URL	https://generalmanual.com/robots.txt
Domain IPs	35.209.133.255
Response IP	35.209.133.255
Found	Yes
Hash	39f9b6f6fc352ac810aad2fbd04340314830b9f019d4805d37eb18e682139619
SimHash	430edbd02181

Groups

googlebot
googlebot-image
googlebot-news
mediapartners-google
adsbot-google
adsbot-google-mobile

Rule	Path
Allow	/

Rule

Path

Allow

bingbot

Rule	Path
Allow	/

Rule

Path

Allow

Other Records

Field	Value
crawl-delay	3

Field

Value

crawl-delay

duckduckbot

Rule	Path
Allow	/

Rule

Path

Allow

*

Rule	Path
Disallow	/
Disallow	/down.php
Disallow	/go.php
Disallow	/pdf.php

Rule

Path

Disallow

/down.php

Disallow

/go.php

Disallow

/pdf.php

smtbot
daum
coccocbot

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

criteobot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

xovibot

Rule	Path
Disallow	/

Rule

Path

Disallow

owler

Rule	Path
Disallow	/

Rule

Path

Disallow

genai

Rule	Path
Disallow	/

Rule

Path

Disallow

awariorssbot
awariosmartbot

Rule	Path
Disallow	/

Rule

Path

Disallow

zoombot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

criteobot

Rule	Path
Disallow	/

Rule

Path

Disallow

mojeekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

sirdatabot

Rule	Path
Disallow	/

Rule

Path

Disallow

seekportbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshot

Rule	Path
Disallow	/

Rule

Path

Disallow

ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

clickagy intelligence bot v2

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot-web

Rule	Path
Disallow	/

Rule

Path

Disallow

ias_crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

domainstatsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

netseer

Rule	Path
Disallow	/

Rule

Path

Disallow

panscient.com

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.generalmanual.com/sitemap.xml

Field

Value

sitemap

https://www.generalmanual.com/sitemap.xml

generalmanual.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

googlebotgooglebot-imagegooglebot-newsmediapartners-googleadsbot-googleadsbot-google-mobile

bingbot

Other Records

duckduckbot

*

smtbotdaumcoccocbot

meta-externalagent

amazonbot

criteobot/0.1

xovibot

owler

genai

awariorssbotawariosmartbot

zoombot

imagesiftbot

amazonbot

criteobot

mojeekbot

dataforseobot

applebot

sirdatabot

seekportbot

gptbot

barkrowler

grapeshot

ru_bot

ahrefsbot

proximic

serpstatbot

clickagy intelligence bot v2

coccocbot-web

ias_crawler

semrushbot

ccbot

domainstatsbot

cliqzbot

mj12bot

netseer

panscient.com

dotbot

Other Records

generalmanual.com
robots.txt

googlebot
googlebot-image
googlebot-news
mediapartners-google
adsbot-google
adsbot-google-mobile

smtbot
daum
coccocbot

awariorssbot
awariosmartbot