Dear Worldcon Community,
We have received questions regarding Seattle’s use of AI tools in our vetting process for program participants. In the interest of transparency, we will explain the process of how we are using a Large Language Model (LLM). We understand that members of our community have very reasonable concerns and strong opinions about using LLMs. Please be assured that no data other than a proposed panelist’s name has been put into the LLM script that was used. Let’s repeat that point: no data other than a proposed panelist’s name has been put into the LLM script. The sole purpose of using the LLM was to streamline the online search process used for program participant vetting, and rather than being accepted uncritically, the outputs were carefully analyzed by multiple members of our team for accuracy.
We received more than 1,300 panelist applicants for Seattle Worldcon 2025. Building on the work of previous Worldcons, we chose to vet program participants before inviting them to be on our program. We communicated this intention to applicants in the instructions of our panelist interest form.
In order to enhance our process for vetting, volunteer staff also chose to test a process utilizing a script that used ChatGPT. The sole purpose of using this LLM was to automate and aggregate the usual online searches for participant vetting, which can take up to 10–30 minutes per applicant as you enter a person’s name, plus the search terms one by one. Using this script drastically shortened the search process by finding and aggregating sources to review.
Specifically, we created a query, including a requirement to provide sources, and entered no information about the applicant into the script except for their name. As generative AI can be unreliable, we built in an additional step for human review of all results with additional searches done by a human as necessary. An expert in LLMs who has been working in the field since the 1990s reviewed our process and found that privacy was protected and respected, but cautioned that, as we knew, the process might return false results.
The results were then passed back to the Program division head and track leads. Track leads who were interested in participants provided additional review of the results. Absolutely no participants were denied a place on the program based solely on the LLM search. Once again, let us reiterate that no participants were denied a place on the program based solely on the LLM search.
Using this process saved literally hundreds of hours of volunteer staff time, and we believe it resulted in more accurate vetting after the step of checking any purported negative results. We have also not utilized an LLM in any other aspect of our program or convention. If you have any questions, please get in touch with program@seattlein2025.org or chair@seattlein2025.org.
Kathy Bond
(she/hers)
Chair Seattle Worldcon 2025
chair@seattlein2025.org