This extension lets you generate a sitemap for any public website right in your browser. While generating the sitemap, the extension renders the web pages and waits for javascript to load, making it great for crawling dynamic single page applications made with angular, react, etc.
This extension works by taking some start URL, crawling that page for more links, and then recursively crawling those pages for more links. Once all discovered links have been checked, the extension outputs a sitemap file.
This implementation is not practical for website containing tens of thousands of pages. It can however, crawl a few thousand entries in a reasonable amount of time.
================================
Privacy Policy
================================
This application does not collect not store information about any individual user.
This application does not use persistent storage. All applications
data is kept in runtime memory only.
When application runs, it generates a sitemap for specific domain user
has selected and only after user has explicitly granted permission to do so.
Once the application execution ends, all data and the generated sitemap are
lost once memory recycles.
This application may collect anonymized and aggregated usage
data according to google analytics t.o.s to improve user experience
and to identify key functionality. Again, this information does not
identify individual users and follows GA t.o.s.
It is OK-ish, but the output is not parsable by Google, but I could copy the page source. It would be extremely useful to be able to filter out certain URL’s, such as a logout link. Once it visits that one, it (logically) finds now now links anymore 🙁
This extension doesn’t work at all. It crawls the site, then encounters an error and stops. There is neither any information on how I could avoid the error, nor any configuration options I could try.
only 9 links
It runs a long time and when it appears to be finished it keeps on running anyway and there’s no instructions on what to do next.
No site detected my pages, but this extension gets all pages. GREAT tool !!!
Its keeps opening new tabs for crawling… which leads to hang and consume more resources of a system,
CAnt track progress since its hang up and at last all gone….
Awesome sitemap generator for angular website or SPA website. this extension helps me alot to create sitemap in easy way but only one cons i found that is i didn’t get or inside the sitemap.xml file only get the tag with the pages link. i hope in next update version i’ll get these feature. thanks team and developer
Great job all, Thank you very much.
Va muuuuuy lento.
Just crawled the base page then gave up. Tested on my site and another just to make sure it wasn’t a fluke. Rubbish.
Like others have said, it’s a good idea, but it lacks the ability to limit simultaneously open tabs, which makes it impossible to make use of for any other than really small sites.
As for retrieving the sitemap XML, when the crawl is done, it was added to my download queue, which is an acceptable solution to me.
I would have preferred something like an export button though.
It generated a site map great for my website https://laughlete.com . I only wish it would include images in the tags, perhaps by looking for Open Graph metadata or simple using an image on each page.
สามารถสร้างแผนผังเว็บไซต์ได้ https://www.youtube.com/c/ดูดวงตำราพระอาทิตย์โคราช
For my angular website it only fetched the href links present in my home page. Nothing else!
worked great!
The generator works well for some sites, even SPA’s. Sadly when (I believe) a loader is in front the website, the tool seems to think that the website has finished loading. It won’t create more than 1 URL.
A great addition would be if you could set a timer for the page to wait some seconds (perhaps configurable) before returning the XML.
for sitemaps : it’s sure is ridiculous to upload your sitemap all the time, create a xml code which will retrieve all the db from the db so you don’t have to upload all the time. this extension is crazy, opens the tabs so fast it’s slowing the processor down at the same time browser freezes. delay for 5 sec. before you open a another tab.
here is a example:
https://apps.oscommerce.com/QN8hJ&google-xml-sitemap-seo
good
It opens a tab then immediately closes it for every new page…
had close to 2k pages, the program knocked it out no problem.. with no errors.. thanks!
Very bad extension . when generating sitemap so much error coming . Time waste Extension.
100% sucks. It required odd permissions and then completely failed to crawl a basic site (https://cosourcery.com/). Literally only listed the base URL I gave it…
Perfect for our university website. The output was 100% accurate with no missing pages and didn’t go beyond our domain.
no pude crear el sitemap de mi sitio y deja el navegador casi sin poder usar mientras se ejecuta. Otra cosa es que consume demasiada memoria
Fine Extension, only thing it needs is somehow to manage how many pages it opens simultaneously. Limiting RAM usage is a must with limiting how many tabs it opens in same time.