I've built some widget for websites which is asynchronously loaded after the page is loaded:
<html>
<head>...</head>
<body>
<div>...</div>
<script type="text/javascript">
(function(){
var ns = document.createElement("script");
ns.type = "text/javascript";
ns.async = true;
ns.src = "http://mydomain.com/myjavascript.js";
var s = document.getElementsByTagName("script")[0];
s.parentNode.insertBefore(ns, s);
})();
</script>
</body>
</html>
Is there anyway to notify Google's crawler to index the page only after the page is fully loaded (after the async JavaScript modified the HTML)?
Crawling: Google downloads text, images, and videos from pages it found on the internet with automated programs called crawlers. Indexing: Google analyzes the text, images, and video files on the page, and stores the information in the Google index, which is a large database.
Crawling is the discovery of pages and links that lead to more pages. Indexing is storing, analyzing, and organizing the content and connections between pages. There are parts of indexing that help inform how a search engine crawls.
We ran a series of tests that verified Google is able to execute and index JavaScript with a multitude of implementations. We also confirmed Google is able to render the entire page and read the DOM, thereby indexing dynamically generated content.
Most of our Search index is built through the work of software known as crawlers. These automatically visit publicly accessible webpages and follow links on those pages, much like you would if you were browsing content on the web.
No. You have to set up static mirror pages for asynchronous content. See here: http://code.google.com/web/ajaxcrawling/docs/getting-started.html
Things have evolved since then:
- Google crawls and indexes all content that was injected by javascript.
- Google even shows results in the SERP that are based on asynchronously injected content.
- Google can handle content from httpRequest().
(...)
- Dynamically updated meta elements get crawled and indexed, too.
Source: http://www.centrical.com/test/google-json-ld-and-javascript-crawling-and-indexing-test.html
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With