Alex Bevilacqua
Posted on May 3, 2023
As a Product Manager, data is everything when it comes to making decisions. One of my responsibilities as a PM for Developer Interfaces is to understand how our developer communities work most effectively, and what their preferred tooling and stacks look like.
When focusing on the Ruby developer community, a simple question to ask would be "What is your favourite editor/IDE when working with Ruby / Rails?" JetBrains' developer survey from 2021 found that 48% of Ruby developers mostly use RubyMine - which may be accurate - but the survey was run by the vendor responsible for RubyMine and may have skewed results based on their sample group consisting of fans/customers/users of their products.
Setup
I wanted to try running my own survey to see if the responses align with what JetBrains found. Since my Reddit survey was conducted 2 years after JetBrains' how have things changed?
This was my first time running a Reddit poll, but found the community to be extremely engaged and willing to provide honest and targeted feedback. I only setup the poll to run for 72 hours, but during that time period I received:
- 931 Votes
- 20K Total Views
- 50 Upvotes
- 41 Comments
Unfortunately Reddit doesn't appear to consistently present engagement statistics (views, upvotes) so this is an approximation based on observation during the period the poll was open.
Results
The poll contained 6 options (the maximum Reddit allows) and was open from 2023-04-25 to 2023-04-28.
Based on feedback I'd received in the comments I updated Vim to also include Neovim, however I'd have preferred to keep these options separate.
The fact that Visual Studio Code was almost half of the poll's respondents favourite editor wasn't surprising, however over a quarter still favoured RubyMine. This is far less that what JetBrains found, but my sample size is much smaller and audience potentially more diverse. Still the size of the user base for RubyMine is large enough that it should not be discounted when developing strategies when discussing developer tooling for Ruby specifically!
Outcome
The goal of this exercise was to learn 2 things specifically:
Based on Reddit, what are Ruby developers favourite IDEs or Editors
The main IDEs/Editors currently favoured by the users I polled were Visual Studio Code, Neovim and RubyMine. I had an entry in the poll of "Other", which I believe (based on the comments) is as follows:
Developers also seem to prefer editors that support Solargraph for Intellisense.
Is Reddit a good platform for this type of exercise
Depending on the community/subreddit you choose to run the poll in your mileage may vary. The r/rails subreddit has 57K users, so the chances of getting decent engagement were moderate, and given that I only ran this poll for 3 days I feel the response rate was quite high.
I will definitely use this method again in the future.
Conclusion
When promoting this poll I posted to LinkedIn and Twitter only. Some of the feedback I got alluded to Reddit potentially discouraging some participation as users may not have accounts and may not want to create an account just to vote in a poll. Further to this, Reddit limits the number of items you can include in your poll to 6 items and it seems this is by design and won't be increased any time soon.
Being able to capture feedback from participants without there being a barrier to entry (like creating an account on Reddit) may improve engagement, however there is definite value in targeting a poll directly to the community represented in a subreddit.
Posted on May 3, 2023
Join Our Newsletter. No Spam, Only the good stuff.
Sign up to receive the latest update from our blog.