jean-luc

Public post dump?

Recommended Posts

I've been thinking about doing like a word cloud or a markov chain of tulpa.info posts, and I was wondering if I could maybe get a dump of all the public posts on tulpa.info? Is that possible? I know I could write a scraper bot to get it all but I'm not sure if that would be appreciated.


Stats for LOTPW

Share this post


Link to post
Share on other sites

Lumi: Don't you worry, I made it for you.

 

SQKkuKE.png

 

Honestly there's no point in making another now.

just kidding, of course


Hi guys, plain text is just me now! We've each got our own accounts: me, Tewi, Flandre, and Lucilyn. We're Luminesce's tulpas.

Here's our "Ask Thread", and here's our Progress Report (You should be able to see all of our accounts on the second page if you want)

Share this post


Link to post
Share on other sites

I am going to write a bot that reads in every thread. on tulpa.info and gets the contents of all the posts.

 

This is nothing you should be worried about, Why would you be worried about this?


Stats for LOTPW

Share this post


Link to post
Share on other sites
Guest Anonymous

Some sort of shadow government men in black cyber spying conspiracy! They are watching Mistgod, always watching!

Share this post


Link to post
Share on other sites

any search engine indexer (eg google) does the same thing. robots.txt allows it, so figure I'm good.

 

As for the how, I plan to write my own program to scrape pages. I'll use an html parser library like Nokogiri


Stats for LOTPW

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Recently Browsing   0 members

    No registered users viewing this page.