jean-luc November 27, 2015 November 27, 2015 I've been thinking about doing like a word cloud or a markov chain of tulpa.info posts, and I was wondering if I could maybe get a dump of all the public posts on tulpa.info? Is that possible? I know I could write a scraper bot to get it all but I'm not sure if that would be appreciated. Stats is back: https://stats.jean-luc.org/ My visits to tulpa.info are chaotic. If you want me to see something, make sure to quote a post of mine or ping me @jean-luc
Reisen November 27, 2015 November 27, 2015 Lumi: Don't you worry, I made it for you. Honestly there's no point in making another now. just kidding, of course Hi guys, plain text is just me now! We've each got our own accounts: me, Tewi, Flandre, and Lucilyn. We're Luminesce's tulpas. Here's our "Ask Thread", and here's our Progress Report (You should be able to see all of our accounts on the second page if you want)
jean-luc November 27, 2015 Author November 27, 2015 I could write a scraper bot to get it all but I'm not sure if that would be appreciated. Wait, what am I talking about?? This is exactly what googlebot does. Stay tuned. Stats is back: https://stats.jean-luc.org/ My visits to tulpa.info are chaotic. If you want me to see something, make sure to quote a post of mine or ping me @jean-luc
jean-luc November 27, 2015 Author November 27, 2015 I am going to write a bot that reads in every thread. on tulpa.info and gets the contents of all the posts. This is nothing you should be worried about, Why would you be worried about this? Stats is back: https://stats.jean-luc.org/ My visits to tulpa.info are chaotic. If you want me to see something, make sure to quote a post of mine or ping me @jean-luc
Guest Anonymous November 27, 2015 November 27, 2015 Some sort of shadow government men in black cyber spying conspiracy! They are watching Mistgod, always watching!
TheCrawlingCreepypasta November 27, 2015 November 27, 2015 Is that legal on here? I doubt you're doing this for any malicious reasons, but you might want to review the terms again. BTW, how do you plan to do this, Mozenda, Importio, what tool?
jean-luc November 27, 2015 Author November 27, 2015 any search engine indexer (eg google) does the same thing. robots.txt allows it, so figure I'm good. As for the how, I plan to write my own program to scrape pages. I'll use an html parser library like Nokogiri Stats is back: https://stats.jean-luc.org/ My visits to tulpa.info are chaotic. If you want me to see something, make sure to quote a post of mine or ping me @jean-luc
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.