Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Find ALL tweets from a user (not just the first 3,200)

With https://dev.twitter.com/docs/api/1/get/statuses/user_timeline I can get 3,200 most recent tweets. However, certain sites like http://www.mytweet16.com/ seems to bypass the limit, and my browse through the API documentation could not find anything.

How do they do it, or is there another API that doesn't have the limit?

like image 710
apscience Avatar asked Dec 12 '11 08:12

apscience


People also ask

Why does Twitter only show 3200 tweets?

In your Tweets tab, we display 800 of your most recent Tweets, while in your Tweets & replies tab we display 3,200 of your most recent Tweets and replies. Truncated profile timelines can be caused by: Accounts deleting many Tweets in a row from their profile. Accounts that run a mass-deletion program on their profile.

How do you find tweets from a specific date?

To access this feature, visit Twitter's advanced search page. Clicking that link will open advanced search in a pop-over window on the web-based version of Twitter. Search for tweets by a specific date by scrolling all the way down to the bottom of the pop-over window.


2 Answers

You can use twitter search page to bypass 3,200 limit. However you have to scroll down many times in the search results page. For example, I searched tweets from @beyinsiz_adam. This is the link of search results: https://twitter.com/search?q=from%3Abeyinsiz_adam&src=typd&f=realtime

Now in order to scroll down many times, you can use the following javascript code.

    var myVar=setInterval(function(){myTimer()},1000);
    function myTimer() {
        window.scrollTo(0,document.body.scrollHeight);
    }

Just run it in the FireBug console. And wait some time to load all tweets.

like image 156
sevenkul Avatar answered Oct 14 '22 10:10

sevenkul


The only way to see more is to start saving them before the user's tweet count hits 3200. Services which show more than 3200 tweets have saved them in their own dbs. There's currently no way to get more than that through any Twitter API.

http://www.quora.com/Is-there-a-way-to-get-more-than-3200-tweets-from-a-twitter-user-using-Twitters-API-or-scraping

https://dev.twitter.com/discussions/276

Note from that second link: "…the 3,200 limit is for browsing the timeline only. Tweets can always be requested by their ID using the GET statuses/show/:id method."

like image 35
meetar Avatar answered Oct 14 '22 10:10

meetar