Posts

Replace Azure Scheduler with Azure Functions

Image
I have written before about the shortcomings of the Azure Scheduler  (doesn't integrate with classic [non-RM] Azure Storage accounts, message body pushed to Azure Storage Queue is wrapped in XML, costs $15/mo for basic scheduling tasks...) but the good news is, now with Azure Functions , your Scheduler Tasks can mostly be replaced with Functions. Here are a couple tables to break down the differences in Triggers and Actions. Scheduler Triggers compared to Function Input Bindings Scheduler Functions Manual X X Timer X X Http X Storage Queue X Service Bus Queue X Service Bus Topic X Blob X Event Hub X Scheduler Actions  compared to Built-in Function Output Bindings   Scheduler Functions Http X X Storage Queue X X Service Bus Queue

Census.gov QuickFacts Data Set

To create a visualization for  https://www.sizzleanalytics.com/  I had to compile census information from the census.gov QuickFacts tool. As for as I could tell, they don't provide an easy way to automatically download all the data, so I manually downloaded each state then used a simple node script to merge them together. Data set available here: https://data.world/aaronhoffman/census-gov-state-quickfacts Hope this helps, Aaron

Azure Functions and AWS Lambdas

I'm working on a new talk about Azure Functions and AWS Lambdas . I'm writing this blog post to compile a list of links to more information for people that attended the talk. Presentation Slides:  https://drive.google.com/open?id=0BwgLvVq0rcS7cmxrQUhCWUxTNTQ Azure Function Intro Source Code:  https://github.com/Stonefinch/AzureFunctionIntro Azure Intro Web App Source Code:  https://github.com/Stonefinch/AzureIntro Azure Function Tools for Visual Studio:  https://blogs.msdn.microsoft.com/webdev/2016/12/01/visual-studio-tools-for-azure-functions/ AWS Lambda C# in Visual Studio:  https://aws.amazon.com/blogs/developer/using-the-aws-lambda-project-in-visual-studio/ I'll add more links and update the slides as I continue to build out the talk. Hope this helps, Aaron

Hacker News Dataset October 2016

Image
Our latest project on Sizzle  is a visualization of the Top 10k Posts of All Time  on Hacker News . To create the visualization, we first needed to collect the data. I noticed that there was an old copy of the hacker news dataset available on Big Query . But I needed an up-to-date copy, so I looked into the Hacker News Firebase API . The API allows you to get each item by Id. You can start by retrieving the current Max ID, then walking backwards from there. (Items my be stories, comments, etc., it's the same API endpoints for all types of items.) There is no rate limit, so I created the following script that will generate a text file with 10MM lines containing all of the URIs to retrieve. (we will then feed this file into wget using xargs) Note: 10MM items was ~5 years worth of data. Script to create the 10MM line file of URIs to retrieve: https://gist.github.com/aaronhoffman/1f753c660d7364bb594a36af350b227c That script takes about 10 minutes to produce a file t

Top Cities in the United States

To find a data source for visualizations , I found myself commonly searching for "Top 200 Cities in the US", "largest cities by land area", and "largest meto area by population", etc. I would then have to combine the list I found with other data sources to get all the info I needed. I thought I'd try to keep an up-to-date copy of this list, in case others also found this helpful. You can find that list here:  https://gist.github.com/aaronhoffman/e1893d32fa1254429abf57f5c0413fa3 I will try to keep this list up-to-date with additional information and API keys as I use it over time. Hope this helps, Aaron

Reddit API OAuth C# .NET Example

Image
I had a need to connect to the Reddit API via C# .NET, and thought I'd put this little tutorial together since most I found were in java or python. Note: General Reddit OAuth API info:  https://www.reddit.com/dev/api/oauth 1. Go here and make an app:  https://www.reddit.com/prefs/apps 2. Use the values from the app you created above, in this code sample:   gist:  https://gist.github.com/aaronhoffman/b59585d507601b05d8db02493eaaf73e   more info:  https://github.com/reddit/reddit/wiki/OAuth2 3. Make API requests:   gist:  https://gist.github.com/aaronhoffman/b59585d507601b05d8db02493eaaf73e Check out the result here : interactive data visualization Hope this helps, Aaron

VirtualBox Right-Click Windows Taskbar On Mac

Using VirtualBox on my Mac (in windowed mode, not full screen), I noticed that right-click on the Windows taskbar was not working. I commonly use right-click on the task bar to launch an application as administrator, pin an application to the taskbar, etc. I could two-finger click on other windows to get the right-click menu to appear, but that did not work on the taskbar. To get the right-click menu to appear on the windows taskbar, I had to hold down the "host key" which for me was the left Mac command key, and single-finger click the item in the taskbar. Hope this helps! Aaron