On the community map, you wrote:
I think we did a decent job promoting, and demand is just genuinely low.
What are the main things you did to promote the map?
Are you sure you've tested demand carefully enough?
Behaviour = motivation * ability * trigger. What is the trigger for using the map?
Personally, when the map was announced, I set my location and did a quick map search. But then I totally forgot that the map exists until I read your post today.
I think the key design challenge for the map product is to deliver an ongoing stream of well-timed prompts to use it.
I want to notice whenever someone I've interacted with on the forum is in the same city as me. You could tell me about this:
(a) Whenever I interact with someone (e.g. their username name is visually highlighted if they're nearby).
(b) When one of us change location (e.g. you keep a list of people I've interacted with, then trigger a notification when one of them is nearby*).
Ideally the EA Forum would request location access and update my location automatically whenever I log on. If I don't consent to that, then it should periodically remind me to update my location, with the timing of those reminders perhaps partly based on IP address changes.
*Probably you'd want to rate-limit these a bit, and prioritise by things like recency and volume of interaction.
Adding on to this - we had a maps functionality on the EA Hub (eahub.org), but never tried to promote it or saw it as a particularly useful way to achieve the use case of "people nearby want to meet".
To do that, we launched more advanced search functionality and a "EA Chats" which would have allowed matching on location. That functionality that was not launched, but had some good beta feedback of EA Pen Pals (and the 2015 version of EA Chats).
In general, we consulted closely with local group organizers to build functionality that would help them facilitate connections themselves (they were perhaps the "trigger").
Unfortunately we were not able to test this out because we decided to retire the Hub before that, but my guess is that either of those versions would have been more robust ways of testing the functioanlity.
I have found this post really interesting and useful....thanks for posting!
You write that 'the Forum wasn’t designed well' for meaningful connections. I am researching online communities and wondered in what ways the EA forum was deficient in this area in you opinion? Do you have other forums in mind that do facilitate more meaningful connections?
One idea for increasing connections: when I interact with someone on the Forum, encourage me to follow them on Twitter.
Ways you might do this:
Everywhere a Forum username is shown, add a bird icon that links to their Twitter profile.
When I upvote, reply or send a DM, prompt me to follow the person on Twitter.
Periodically email me a list of Twitter profiles of the EA Forum users I interact with the most.
I imagine (1) would get a lot of the value, and it's cheap to test.
Generally I think it would be interesting to brainstorm on ways that EA Forum could interact with EA Twitter, and vice versa.
Re: Swapcard, you wrote:
A timebound conference creates an artificially highly liquid market for conversations.
I think there are good ways to create virtual timebounds. Prime Day works pretty well for Amazon.
Here's a sketch of one possible path:
Every Xth of the month is "Connection day". People are encouraged to reserve several hours for calls on this day.
In the run up to "Connection day", Forum users are prompted to suggest "Connection day" calls with each other.
The Forum helps you generate ideas for who to connect with. E.g.
3a. There's a "Connection day" page that lists all the Forum users you've interacted with, ranked by recency and depth of interaction.
3b. There's a list of all your Twitter mutuals, plus some "recommended follows".
3c. There's an easy way to suggest that Forum users you know reach out to someone in particular.
Lots of details to fill in here, but I would definitely try this, if it existed.
The biggest issue with building a directory is getting people to actually use it.
"Use it" breaks down into (a) "sign up" and then (b) "ongoing use".
The EA Forum has an incredible edge on both dimensions—you've already passed these hurdles for the Forum itself.
If anyone can make an EA directory product work, it's probably going to be the EA Forum.
Personally I find Twitter and email far more helpful than EAG for making new connections, and for meeting up with people I already know.
It's not a close call—I'd estimate 2-10x better per hour of time spent trying to connect (including travel time).
Given that, I've more or less stopped going to EAGs.
I've been to at least 5 EAGs.
About 80% of the "connection" value came from the following process:
Most of the rest came from "bump into" effects, where seeing someone in a corridor reminds me that I'd like to speak to them, and so I do. And vice versa.
I imagine many people get a lot of value from the "off venue" parties—I skip those because I hate parties.
I've attended a couple of interest/skill-specific "speed dating" sessions over the years and found them fairly useless.
The main ways I see EAG as being optimised for connections are:
The actual conference venue is usually a bad place to speak. It's noisy and if you're in a public place, people often interrupt your conversations. I do ~all of my meetings outside the venue, usually walking nearby.
(I'm not sure why people attend talks at EAG—I just want to watch at 2x on the internet.)
Crazy thought: I wonder what would happen if you ran an EAG where the physical venue was just "Central London" and then people watch talks on the internet and arrange IRL meet ups.
If I can easily be in the same city as an EAG event I am pleased about that, because it's raises the chance that someone I'd like to see in person is less than 25 miles away.
I sometimes remember to check if people I'd like to meet are around a few days before the conference starts. I wish I remembered to do that more consistently.
I also wish I could more easily find out who is attending, whether or not I am not attending. Sometimes that would make me decide to be in the relevant city, even though I am not attending.
I feel pretty unsure how high the EAG bar is.
How much do you know about the quality of the EAG connections? How is that quality-adjusted connection calculated?
(Maybe too much of a tangent. NNTR.)
I’ve been exploring ideas for how the Forum could help people make a valuable connection over the course of 4+ months. In this doc, I share the different areas I’ve been thinking about, how promising I think they are and what I’ve learnt about them.
Overall, I don't think any of the ideas meet the bar for focusing on connections via an online platform. My bar for an idea was that it could facilitate roughly an EAG’s worth of quality-adjusted connections each year (~10,000). I’m now more excited about meeting this bar by targeting high-value outcomes (e.g. collaborations, jobs), even if that means a lower number of total connections.
I cover:
I’m more excited about targeting high-value outcomes that come from connections (e.g. collaborations, jobs) rather than trying to broadly facilitate conversations online.
The rest of this contains details on what we explored, why and our assessment of each idea.
We thought we should work on connections because:
Caveats:
I’m sharing a table summary below, and you can see elaborations below.
| Category | Depth of exploration | Assessment | Explanation | Evidence |
Get cause-specific career advice
| In depth | Somewhat promising | Real demand but not that much and I think hard to reach the scale of an EAG. | Ran a pilot for a biosecurity advice service. |
| Get advice from a professional | In depth | Somewhat promising | Real demand but not enough. Worse than cause-specific advice. | Created an MVP blog post. Assessed EA London directory. |
| Connecting with someone who lives nearby | In depth | Not promising | After building a map of community members, we’ve seen ~2 messages per month sent to someone on the map | We built a map Community - EA Forum. |
| Advertising jobs | Medium | Promising | Software devs we surveyed weren’t aware of jobs they could apply to, and 3/12 applied to a job. | Reviewed job ads on the forum. Ran a number of surveys. |
| Recruiting candidates | Medium | Somewhat promising | Some orgs really wanted it. Others were less excited. Other recruiters are starting to fill this gap. | Spoke to 10+ recruiters. |
| Help online group organisers get their members to engage | Medium | Somewhat promising | Some interest in an alternative to Slack. People are using subforums. | Spoke to five online group organisers. A version of this is currently live. |
| Help community builders connect members to the broader EA community | Medium | Worth pursuing for some uni groups but not for our team | Most community builders have people they want to connect members with from their own network. | Spoke to 20 group organisers.
|
| Verifying someone for a grant | Shallow | Not promising | Not a big problem/time saver | 2 calls with grant makers at EA Funds. |
| Finding projects or grantees for regrantors | Shallow | Not promising | Not a hair on fire problem. People weren’t actively looking outside their existing networks/communities. | 4 conversations with regrantors. |
| Help people find jobs | Shallow | Not promising | People mostly seemed to feel ok about their job hunt (surprisingly). | Spoke to 6 people from the “Who wants to be hired” thread. |
| Connecting peers with mutual interest | Shallow | Somewhat promising | People join online groups for this reason but it’s not clear how to nudge people to have conversations or if people want this. | Online Slack groups facilitate this but often not super active. Spoke to one student who was interested in this. |
| Help people figure out which jobs are the highest impact | Shallow | Somewhat promising | I think it would be good for 80k’s job board to be clearer about which jobs are good for direct impact vs career capital and to highlight which are controversial, but I’m not convinced it would make a big difference to what jobs people take. | Chat with 80k. Chat with Yonatan. Posted a forum post that highlighted an expert’s view on top jobs. |
This has been suggested a number of times by different people, because:
My view on this:
I think there is also an argument that goes:
I feel pretty tempted by this argument, and it’s nice to build stuff, but I think without a specific use case you’re kind of just hoping people will use your new service.
It might be worth saying that it is possible to search for Forum users by keywords in their profile and any tags they’ve added to their profile here — and you can message people! If this gets a lot of use and I learn of valuable outcomes from this search, it could change my mind about whether we should spend more time on something like a general-purpose directory.
We explored these ideas in some depth, building prototypes that people used. All these ideas showed some promise, so I could imagine changing my mind about them.
Why?
When people are looking for advice they often want to speak to people who know the cause area. One of the ways that 80,000 hours provide value is referring coachees to cause area experts who can bring them up to speed and make further introductions. It seemed plausible that it would be useful for people to reach out to these experts directly.
This was one of the use cases I tested most thoroughly. We ran a pilot to connect people interested in biosecurity with more senior people in biosecurity (currently doing PhDs or working in the field). If you’re thinking of doing something like this, I’d be happy to share more info and discuss.
Take
I think this was a pretty useful thing to do, but the results after running for a month weren’t amazing and I couldn’t see a way to scale it up to be EAG-level good.
Others at CEA disagreed with my overall assessment of the pilot and thought the service could be worth continuing to run, even if at a small scale.
It’s possible someone else should take this on as a side project, or individual interest groups (e.g. consulting, psychology) should have something like this.
Evidence
Why?
We’d heard of people reaching out to forum authors to ask for advice. I think getting career advice from a professional is one of the common conversations people have at EAG. I had a guess that people would reach out if they felt they had permission to. We were very close to launching this, but then decided the numbers wouldn’t be large enough for it to be worth it.
Take
There was a real demand for a professional advice program, but I don’t think enough to warrant scaling one up. I think this was worse than the biosecurity advice pilot we ran, because we had no filter on who could apply and so people took it less seriously.
Evidence
We did a cheap test by listing people in different careers on a forum post: “Book a chat” with an EA professional. The results looked quite a bit worse than the biosecurity advice pilot:
That said, it was promising that some subset of advisors were happy to do many calls and felt they were a decent use of time. I think there’s something to be said for giving people permission to reach out to the subset of senior people who enjoy doing these calls. A counterargument is that it’s possible these senior people aren’t valuing their time highly enough and we’re distracting them. It should be noted that most of them did not want to spend more time having EAG-like conversations (they saw EAG as their give-back budget).
I also looked into how the EA London directory was used, because it seemed like the best existing example of the get advice service. It seemed like it was most often used when someone was going through a career transition (e.g. finishing a PhD or switching from Finance to Software) and wanted to speak to someone who worked in that area to get practical advice and leads for jobs. This got a surprisingly low uptake though, given it was heavily promoted by the EA London community leaders. We estimated that 40 messages were sent a year and that 2.5% of visitors to the page sent a message. If 2.5% of all monthly Forum visitors (25k) sent a message, this would be 500 messages a year, which seems optimistic and wouldn’t be close to our target. We’d need about 8x as many messages.
Why?
This seems like one of the key features of the EA Hub. I think having a friend who is interested in EA can be very motivating and matching people can lead to new EA groups. So we created a map for Forum users who wanted to share their approximate location.
Take
The feature hasn’t been used much. It’s possible we should delete this feature, as it’s distracting to have.
You could argue that we should have done more to promote it and worked harder to get more people on the map - the usefulness of this is of course only as valuable as the number of people on it. But I think we did a decent job promoting, and demand is just genuinely low.
Evidence
We created the map in May, and a couple messages a month are sent through the map.
We spoke to a decent number of users and/or ran tests, so we feel somewhat confident about our positions on these ideas.
Why?
We know posts on the Forum have played a role in people applying for jobs, and we think this might be one of the main sources of the Forum’s impact.
Take
I think we could play a role in generating more leads for recruiters. I particularly think there might be an opportunity to do this with EAG attendees as well as the Forum. It seems like there are a decent number of people who aren’t aware of jobs that are a match for them or can be nudged to consider jobs.
Evidence
Why?
Helping hiring managers find counterfactual hires seems particularly valuable. We’d heard of people spotting talent through well-written Forum posts. We also know that the EA Hub was used by hiring managers to source candidates.
Take
I think there are a subset of hiring managers who are very excited about new sources of leads. Others have a relatively easy time hiring and don’t need additional help. There are a number of recruitment projects starting and I suspect they will fill the gap, but I think we may be in a position to help provide lists of candidates for recruiters.
Evidence
When we spoke to 10+ hiring managers about recruiting people, it didn’t seem like we found a hair-on-fire problem. About half were uninterested in receiving a long list of candidates. A couple were very enthusiastic. This mixed reaction, paired with it looking like other people were going to enter the space, made us back away.
That said, we still think CEA’s data (from people who have agreed to share it with other organisations) would be useful for recruiters (though perhaps not as its own product) and we are working on making data available to hiring organisations where users have explicitly opted-in to sharing.
Why?
I spoke to a couple of people who made valuable connections through Slack groups. We wondered if we could help online group organisers better connect people online. The theory being that perhaps individual members of an online group (e.g. EA Creatives & Communicators) don’t have a burning need to better connect, but the group organisers might have a stronger desire to help people connect.
Take
There was some interest from online group organisers in having an alternative to the many Slack groups. It seems plausible that the EA Forum could host this, and this is being experimented with currently (see Subforums).
Evidence
Some online group organisers we spoke to were interested, and subforums are getting some use.
Why?
We explored how we could help group organisers connect their members to the broader EA community. I was excited about this based on chatting with David Nash, who connects new EA London members to relevant people in the community on a daily basis. David uses his personal LinkedIn to do this so it seemed like replicating this could be valuable.
Take
Unfortunately, after chatting to 20+ group organisers, it turns out:
However, I think smaller university groups that have leaders without an established network could benefit from some kind of directory. It's possible that the CEA groups team will take something like this on in future, depending on other priorities.
Evidence
We only had a couple of calls about each of these ideas, and I could imagine changing my mind about them.
We thought the Forum could be helpful for verifying grantees and seeing their work, but this didn’t seem very important after chatting with a few people. At best it saved grantors some time, but didn’t make the difference between granting or not.
We thought it might be helpful to source potential projects for regrantors to fund. We were excited about regrantors because there are a lot of them. After speaking to a few, it seemed like most were not interested in spending additional time seeking out opportunities, and instead funded projects that they came across organically as part of their work.
We spoke to 6 people sourced from the “Who wants to be hired” thread and people who ticked “seeking work” in their Forum profile. Mostly people seemed to feel ok about their job hunt and didn’t seem to need additional help. I’m a bit surprised by this as I would have guessed that finding an EA-related job is hard. That said, the sample size was very small so I wouldn’t be surprised if we changed our mind on this.
There are a number of existing initiatives to help people connect around interests e.g. online Slack and Facebook groups, someone in the EAG DC Slack created a channel for software engineers.
One user we spoke to wanted to meet more peers (students) interested in biosecurity because there were a limited number in his university. We were pretty excited about this and contacted 16 students who were interested in biosecurity to ask if they wanted to connect with him. He had calls with 3 of them and got value out of the conversations. I got the impression that this provided a different kind of value to talking to someone more senior as
In response to this, we added a list of “peers” in biosecurity on the biosecurity advice page. Unfortunately, no messages were sent on the back of this section. This doesn’t feel like a super fair test because we didn’t advertise the page very well (it has had ~500 unique page views since we launched and 38 profiles were viewed), but I think getting traffic to this page would have been hard and even if we did well, we could probably expect to get a similar number of messages sent as the community map gets (a couple a month).
I could imagine the subforums helping with this. Perhaps also EA chats would be useful.
Yonatan has highlighted problems with 80k’s job board here. I thought the Forum might be able to help by creating a space for discussion around which jobs were the highest impact. I spoke to Yonatan more about this and to Kush, who manages the 80k job board.
Overall I think it would be good for 80k’s job board to be clearer about which jobs are good for direct impact vs career capital and to highlight which are controversial, but I’m not convinced it would make a big difference to what jobs people take.
Here’s a list of ideas we didn’t explore because I wasn’t excited, but possibly we or someone else should explore them in the future.
I just wanted to check whether you didn’t accidentally cite the OP Survey rather than the EA Survey? These results and question wording are identical to the 2020 EA Survey: 35.4% said “personal contact with EAs” was “important for [them] getting involved in EA”, 38.7% said personal contact with EAs… had the largest influence on your personal ability to have a personal impact?”
It’s true that the OP survey and EAS asked many of the same questions, and it’s true that the OP survey and EAS tend to get exceptionally similar results (when you filter for highly engaged EAs), but that seems like quite the coincidence, and I don't think OP actually asked both these questions.
Fwiw, I think the OP Survey and EAS are both complementary and it's generally good to cite both. Much more could be written about the circumstances in which it makes sense to use different results of each of these surveys, since I think it is not straightforward. I'd like the survey team to do this sometime, but we lack capacity at present.