smobserved.com
robots.txt

Robots Exclusion Standard data for smobserved.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	smobserved.com
Base Domain	smobserved.com
Scan Status	Ok
Last Scan	2024-06-27T07:22:11+00:00
Next Scan	2024-07-04T07:22:11+00:00

Last Scan

Scanned	2024-06-27T07:22:11+00:00
URL	https://smobserved.com/robots.txt
Redirect	https://www.smobserved.com/robots.txt
Redirect Domain	www.smobserved.com
Redirect Base	smobserved.com
Domain IPs	50.112.150.139
Redirect IPs	50.112.150.139
Response IP	50.112.150.139
Found	Yes
Hash	067d9ea8290d7f1a97d938a7ef331a7dcda37dcb3850d34301a7f40e95f21152
SimHash	222f5de12691

Groups

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gnowitnewsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aspiegelbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mauibot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezoicbot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

cloudflare-alwaysonline

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

facebookexternalhit

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

googlebot

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

msnbot

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

msnbot-udiscovery

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

slurp

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

yandexbot

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

yandeximages

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

*

Rule	Path
Disallow	/cgi-bin/
Disallow	/app/pages_staff/
Disallow	/addyourcomment/
Disallow	/loadstory/
Disallow	/login?r=*
Disallow	/samples/
Disallow	/system/
Disallow	/trash/
Disallow	/upload/
Disallow	/.TEMP/
Disallow	/~.0.lionslight.com/
Disallow	/~.1.lionslight.com/
Disallow	/~.2.lionslight.com/
Disallow	/~.3.lionslight.com/
Disallow	/~.4.lionslight.com/
Disallow	/~.5.lionslight.com/
Disallow	/~.6.lionslight.com/
Disallow	/~.7.lionslight.com/
Disallow	/~.8.lionslight.com/
Disallow	/~.9.lionslight.com/
Disallow	/~.10.lionslight.com/

Rule

Path

Disallow

/cgi-bin/

Disallow

/app/pages_staff/

Disallow

/addyourcomment/

Disallow

/loadstory/

Disallow

/login?r=*

Disallow

/samples/

Disallow

/system/

Disallow

/trash/

Disallow

/upload/

Disallow

/.TEMP/

Disallow

/~.0.lionslight.com/

Disallow

/~.1.lionslight.com/

Disallow

/~.2.lionslight.com/

Disallow

/~.3.lionslight.com/

Disallow

/~.4.lionslight.com/

Disallow

/~.5.lionslight.com/

Disallow

/~.6.lionslight.com/

Disallow

/~.7.lionslight.com/

Disallow

/~.8.lionslight.com/

Disallow

/~.9.lionslight.com/

Disallow

/~.10.lionslight.com/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

Other Records

Field	Value
sitemap	https://www.smobserved.com/sitemap_index.xml

Field

Value

sitemap

https://www.smobserved.com/sitemap_index.xml

smobserved.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

ahrefsbot

amazonbot

blexbot

baiduspider

semrushbot

gnowitnewsbot

mj12bot

petalbot

aspiegelbot

mauibot

ezoicbot

turnitinbot

bingbot

Other Records

cloudflare-alwaysonline

Other Records

facebookexternalhit

Other Records

googlebot

Other Records

msnbot

Other Records

msnbot-udiscovery

Other Records

slurp

Other Records

yandexbot

Other Records

yandeximages

Other Records

*

Other Records

Other Records

smobserved.com
robots.txt