{"id":5333,"date":"2014-08-23T09:00:31","date_gmt":"2014-08-23T09:00:31","guid":{"rendered":"https:\/\/pingler.com\/blog\/?p=5333"},"modified":"2014-08-14T11:02:10","modified_gmt":"2014-08-14T11:02:10","slug":"these-errors-and-mistakes-could-be-blocking-google-from-indexing-you","status":"publish","type":"post","link":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/","title":{"rendered":"These Errors and Mistakes Could Be Blocking Google from Indexing You"},"content":{"rendered":"

\"Indexing\"The only way that your website can be discovered by the masses \u2013 short of a massive paid marketing campaign \u2013 is through search engines. When someone wants to find information or products that relate to what you offer, they can enter a query and find you in no time at all. The only way to be listed in search engines, however, is to have your site consistently indexed by Google and other search engines. Since the dawn of the internet, search engines have used a pretty rudimentary process involving search engine \u201ccrawlers\u201d and \u201cbots\u201d to find all the content on the web. If these crawlers and bots cannot find your pages, then they won\u2019t be discoverable through search engines. We\u2019ll talk about some errors below that could be preventing search engines from finding your pages.<\/p>\n

Check Your Robots File<\/h2>\n

Every website (should) have a file called robots.txt in its directory. This file can be edited to allow only certain directories to be indexed, or to disallow all directories from being indexed. Unfortunately, errors in your robots.txt file can be rather common if you have ever edited it in the past. This in turn may be preventing your pages from being indexed properly. The command for excluding directories will display \u201cuser-agent: *\u201d followed by \u201cDisallow:\u201d and then the directory being blocked. Check your robots.txt file to ensure that no directories you need listed on search engines are classified this way. The exclusion of pages via this file does not make them invisible, but instead prevents search engines from finding\/listing them.<\/p>\n

Your Pages Have Passwords<\/h2>\n

If some of your pages have password protection, then you may be unaware that these sites will not be pinging to Google<\/a>. Some people have created password-protected pages for show or as a way to test the feature out; unfortunately for the owners, this means that no one will be able to find it. If the pages need to be found by search engines, then we highly recommend removing password protection or instead, provide a secondary link or landing page that will explain what the page is about, subsequently linking to it from there.<\/p>\n

JavaScript and Cookies<\/h2>\n

If your pages have elements that require JavaScript or cookies in order to view them, then there\u2019s a good chance that Google will not index this content. Pinging to Google complex code (from the perspective of a crawler that only knows how to handle text\/HTML) will simply be ignored and the page in question will be avoided in the future by bots. Some people use Javascript and cookies to keep content hidden from certain visitors, but you may very well end up keeping it hidden from everyone by preventing it from appearing in search results.<\/p>\n

Conclusion<\/h2>\n

There are three easily corrected ways that you might be hiding content from Google unintentionally. Please be sure to check your website\u2019s robots.txt file to see if there are any errors\/mistakes. Next, verify that none of the pages you need indexed have password protection. Last, check out your JavaScript usage and cookie requirements, as these may also prevent bots and crawlers from finding their way throughout your site.<\/p>\n


\n\t
\n\t\t<\/title><br \/>\n\t<\/head><br \/>\n\t<body><\/p>\n<p style=\"text-align: center;\">\n\t\t\t<a href=\"http:\/\/www.pingler.com\/account\/register\/\" data-wpel-link=\"external\"><img decoding=\"async\" alt=\"\" src=\"http:\/\/www.pingler.com\/affiliates\/banners\/Pingler-468x60-01A.gif\" style=\"width: 468px; height: 60px;\" \/><\/a><\/p>\n<p>\t<\/body><br \/>\n<\/html><\/i><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The only way that your website can be discovered by the masses \u2013 short of a massive paid marketing campaign \u2013 is through search engines. When someone wants to find information or products that relate to what you offer, they can enter a query and find you in no time at all. The only way […]<\/p>\n","protected":false},"author":3,"featured_media":5350,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16,172],"tags":[1067,170,815,176],"class_list":["post-5333","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-google","category-web-design","tag-google","tag-html","tag-indexing","tag-robots-txt"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.1.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>These Errors and Mistakes Could Be Blocking Google from Indexing You - Pingler Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"These Errors and Mistakes Could Be Blocking Google from Indexing You - Pingler Blog\" \/>\n<meta property=\"og:description\" content=\"The only way that your website can be discovered by the masses \u2013 short of a massive paid marketing campaign \u2013 is through search engines. When someone wants to find information or products that relate to what you offer, they can enter a query and find you in no time at all. The only way […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\" \/>\n<meta property=\"og:site_name\" content=\"Pingler Blog\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/facebook.com\/pinglerdotcom\" \/>\n<meta property=\"article:published_time\" content=\"2014-08-23T09:00:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"450\" \/>\n\t<meta property=\"og:image:height\" content=\"450\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Pingler\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Pingler\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\"},\"author\":{\"name\":\"Pingler\",\"@id\":\"https:\/\/pingler.com\/blog\/#\/schema\/person\/4995c81e4dee73f9670af7fd1e1529b9\"},\"headline\":\"These Errors and Mistakes Could Be Blocking Google from Indexing You\",\"datePublished\":\"2014-08-23T09:00:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\"},\"wordCount\":544,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/pingler.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg\",\"keywords\":[\"Google\",\"HTML\",\"Indexing\",\"robots.txt\"],\"articleSection\":[\"Google\",\"Web Design\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\",\"url\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\",\"name\":\"These Errors and Mistakes Could Be Blocking Google from Indexing You - Pingler Blog\",\"isPartOf\":{\"@id\":\"https:\/\/pingler.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg\",\"datePublished\":\"2014-08-23T09:00:31+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage\",\"url\":\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg\",\"contentUrl\":\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg\",\"width\":450,\"height\":450},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/pingler.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"These Errors and Mistakes Could Be Blocking Google from Indexing You\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/pingler.com\/blog\/#website\",\"url\":\"https:\/\/pingler.com\/blog\/\",\"name\":\"Pingler.com\",\"description\":\"Ping\",\"publisher\":{\"@id\":\"https:\/\/pingler.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/pingler.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/pingler.com\/blog\/#organization\",\"name\":\"Pingler.com\",\"url\":\"https:\/\/pingler.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/pingler.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2024\/09\/pingler-logo.jpg\",\"contentUrl\":\"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2024\/09\/pingler-logo.jpg\",\"width\":300,\"height\":160,\"caption\":\"Pingler.com\"},\"image\":{\"@id\":\"https:\/\/pingler.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"http:\/\/facebook.com\/pinglerdotcom\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/pingler.com\/blog\/#\/schema\/person\/4995c81e4dee73f9670af7fd1e1529b9\",\"name\":\"Pingler\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/pingler.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/db71def0321a21d7d90da93e8a25172df87a2673a1d70d32d64cc075558a9597?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/db71def0321a21d7d90da93e8a25172df87a2673a1d70d32d64cc075558a9597?s=96&d=mm&r=g\",\"caption\":\"Pingler\"},\"sameAs\":[\"http:\/\/www.pingler.com\"],\"url\":\"https:\/\/pingler.com\/blog\/author\/pingler\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"These Errors and Mistakes Could Be Blocking Google from Indexing You - Pingler Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/","og_locale":"en_US","og_type":"article","og_title":"These Errors and Mistakes Could Be Blocking Google from Indexing You - Pingler Blog","og_description":"The only way that your website can be discovered by the masses \u2013 short of a massive paid marketing campaign \u2013 is through search engines. When someone wants to find information or products that relate to what you offer, they can enter a query and find you in no time at all. The only way […]","og_url":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/","og_site_name":"Pingler Blog","article_publisher":"http:\/\/facebook.com\/pinglerdotcom","article_published_time":"2014-08-23T09:00:31+00:00","og_image":[{"width":450,"height":450,"url":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg","type":"image\/jpeg"}],"author":"Pingler","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Pingler","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#article","isPartOf":{"@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/"},"author":{"name":"Pingler","@id":"https:\/\/pingler.com\/blog\/#\/schema\/person\/4995c81e4dee73f9670af7fd1e1529b9"},"headline":"These Errors and Mistakes Could Be Blocking Google from Indexing You","datePublished":"2014-08-23T09:00:31+00:00","mainEntityOfPage":{"@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/"},"wordCount":544,"commentCount":0,"publisher":{"@id":"https:\/\/pingler.com\/blog\/#organization"},"image":{"@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage"},"thumbnailUrl":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg","keywords":["Google","HTML","Indexing","robots.txt"],"articleSection":["Google","Web Design"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/","url":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/","name":"These Errors and Mistakes Could Be Blocking Google from Indexing You - Pingler Blog","isPartOf":{"@id":"https:\/\/pingler.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage"},"image":{"@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage"},"thumbnailUrl":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg","datePublished":"2014-08-23T09:00:31+00:00","breadcrumb":{"@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#primaryimage","url":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg","contentUrl":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2014\/08\/8883334_s.jpg","width":450,"height":450},{"@type":"BreadcrumbList","@id":"https:\/\/pingler.com\/blog\/these-errors-and-mistakes-could-be-blocking-google-from-indexing-you\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/pingler.com\/blog\/"},{"@type":"ListItem","position":2,"name":"These Errors and Mistakes Could Be Blocking Google from Indexing You"}]},{"@type":"WebSite","@id":"https:\/\/pingler.com\/blog\/#website","url":"https:\/\/pingler.com\/blog\/","name":"Pingler.com","description":"Ping","publisher":{"@id":"https:\/\/pingler.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/pingler.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/pingler.com\/blog\/#organization","name":"Pingler.com","url":"https:\/\/pingler.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/pingler.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2024\/09\/pingler-logo.jpg","contentUrl":"https:\/\/pingler.com\/blog\/wp-content\/uploads\/2024\/09\/pingler-logo.jpg","width":300,"height":160,"caption":"Pingler.com"},"image":{"@id":"https:\/\/pingler.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/facebook.com\/pinglerdotcom"]},{"@type":"Person","@id":"https:\/\/pingler.com\/blog\/#\/schema\/person\/4995c81e4dee73f9670af7fd1e1529b9","name":"Pingler","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/pingler.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/db71def0321a21d7d90da93e8a25172df87a2673a1d70d32d64cc075558a9597?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/db71def0321a21d7d90da93e8a25172df87a2673a1d70d32d64cc075558a9597?s=96&d=mm&r=g","caption":"Pingler"},"sameAs":["http:\/\/www.pingler.com"],"url":"https:\/\/pingler.com\/blog\/author\/pingler\/"}]}},"_links":{"self":[{"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/posts\/5333","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/comments?post=5333"}],"version-history":[{"count":3,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/posts\/5333\/revisions"}],"predecessor-version":[{"id":5352,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/posts\/5333\/revisions\/5352"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/media\/5350"}],"wp:attachment":[{"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/media?parent=5333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/categories?post=5333"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pingler.com\/blog\/wp-json\/wp\/v2\/tags?post=5333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}