mymemory.co.uk
robots.txt

Robots Exclusion Standard data for mymemory.co.uk

Resource Scan

Scan Details

Site Domain mymemory.co.uk
Base Domain mymemory.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-10T12:39:10+00:00
Next Scan 2025-09-24T12:39:10+00:00

Last Successful Scan

Scanned2025-08-03T12:38:37+00:00
URL https://mymemory.co.uk/robots.txt
Domain IPs 104.21.13.37, 172.67.197.166, 2606:4700:3031::6815:d25, 2606:4700:3035::ac43:c5a6
Response IP 104.21.13.37
Found Yes
Hash 76055e1acee8b7fbe4036f0aa05c89e30f6f8386741f97077df4efd81faf63fb
SimHash 3d24ffc5c571

Groups

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /*price%3D*
Disallow /*manufacturer%3D*
Disallow /*brand%3D*
Disallow /*capacity%3D*
Disallow /*memory_type%3D*
Disallow /*capacity_mah%3D*
Disallow /*camera_type%3D*
Disallow /*connection_type%3D*
Disallow /*output%3D*
Disallow /*read_speed%3D*
Disallow /*write_speed%3D*
Disallow /*battery_size%3D*
Disallow /*bus_interface%3D*
Disallow /*cable_length%3D*
Disallow /*class%3D*
Disallow /*ddr%3D*
Disallow /*mobile_data%3D*
Disallow /*filter_size%3D*
Disallow /*latency%3D*
Disallow /*mhz%3D*
Disallow /*minutes%3D*
Disallow /*module_type%3D*
Disallow /*pins%3D*
Disallow /*texts%3D*
Disallow /*video_class%3D*
Disallow /*speed_rating%3D*
Disallow /*source_connection%3D*
Disallow /*connection_type_2%3D*
Disallow /*data_speed%3D*
Disallow /*network%3D*
Disallow /*charging_standard%3D*
Disallow /*family%3D*
Disallow /*connection_speed%3D*
Disallow /*app_performance%3D*
Disallow /*plug_type%3D*
Disallow /*pegi_rating%3D*
Disallow /*headphone_jack%3D*
Disallow /*kit_size%3D*
Disallow /*wireless_charging%3D*
Disallow /*encryption%3D*
Disallow /*publisher%3D*
Disallow /*colour%3D*
Disallow /*battery_life%3D*
Disallow /*chemical_composition%3D*
Disallow /*type%3D*
Disallow /*design_finish%3D*
Disallow /*material%3D*
Disallow /*mounting_location%3D*
Disallow /*mounting_type%3D*
Disallow /*recording_resolution%3D*
Disallow /*features%3D*
Disallow /*number_of_ports%3D*
Disallow /*sim_format%3D*
Disallow /*payment_option%3D*
Disallow /*genre%3D*
Disallow /*release_year%3D*
Disallow /*voltage%3D*
Disallow /*voice_assistant_support%3D*
Disallow /*battery_type%3D*
Disallow /*power_profile%3D*
Disallow /*globe_finish%3D*
Disallow /*lamp_type%3D*
Disallow /*base_type%3D*
Disallow /*colour_temperature%3D*
Disallow /*lumens%3D*
Disallow /*led_lifetime%3D*
Disallow /*power_consumption%3D*
Disallow /*wattage_equivalent%3D*
Disallow /*dimming%3D*
Disallow /blog/wp-login.php?action=lostpassword
Disallow /sales/order/view
Disallow /blog/tag/*
Disallow /cdn-cgi/l/email-protection
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /magento/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /skin/
Disallow /stats/
Disallow /var/
Disallow /directory/currency/*
Allow /*.js*
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /catalog/product/gallery/
Disallow /oos/
Disallow /finder/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.php$
Disallow /*?SID=
Disallow /checkout/iccart/*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.mymemory.co.uk/sitemap/default.xml
sitemap https://www.mymemory.co.uk/blog/sitemap_index.xml

Comments

  • Google Image Crawler Setup
  • Crawlers Setup
  • ROD
  • Directories
  • ROD
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)
  • Icy Cart

Warnings

  • `noindex` is not a known field.