macobserver.com
robots.txt

Robots Exclusion Standard data for macobserver.com

Resource Scan

Scan Details

Site Domain macobserver.com
Base Domain macobserver.com
Scan Status Ok
Last Scan2024-11-15T05:28:06+00:00
Next Scan 2024-11-22T05:28:06+00:00

Last Scan

Scanned2024-11-15T05:28:06+00:00
URL https://macobserver.com/robots.txt
Domain IPs 104.26.10.200, 104.26.11.200, 172.67.75.32, 2606:4700:20::681a:ac8, 2606:4700:20::681a:bc8, 2606:4700:20::ac43:4b20
Response IP 104.26.11.200
Found Yes
Hash 8990f5e6b58382e70e777bbdb86dc8c3a919eecb74c19a5fbb6db4bcd172185b
SimHash ef0492f245aa

Groups

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

gptbot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/

*

Rule Path
Disallow /cgi-bin
Disallow /includes/newsite/ads/aadcall.php
Disallow /style
Disallow /avantgo
Disallow /archive_broken/
Disallow /artsys/
Disallow /clearcookies/
Disallow /ee_system/
Disallow /fortest/
Disallow /index_old.shtml
Disallow /iui/
Disallow /offline.html
Disallow /path.php
Disallow /wcgi-bin/articles/
Disallow /wcgi-bin/phorum/
Disallow /wp-admin/
Disallow /tmo/forums/observer/
Disallow /*subscribe_now_url*
Disallow /wp-login.php
Disallow /temp
Disallow /subscribers
Disallow /cgi-sys
Disallow /cdn-cgi
Disallow /contest
Disallow /seti
Disallow /dvdailies
Disallow /macbookguide
Disallow /previews
Disallow /exporeport
Disallow /forums
Disallow /gamingnews
Disallow /reports
Disallow /shootouts
Disallow /perspectives
Disallow /macosnews
Disallow /mwc99
Disallow /*?wpfin=tag
Disallow /*recent/?view=unread
Disallow /community/tags/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.macobserver.com/sitemap_index.xml
sitemap https://www.macobserver.com/community/sitemap.xml
sitemap https://www.macobserver.com/manual-sitemaps/sitemaps-from-ee.xml

Comments

  • Disallow: /community/profile/

Warnings

  • `host` is not a known field.