I was using usernames, this was the issue, thank you!
I do remember thinking that might be it but there was another place it mentioned using IDs and usernames worked for me so I felt like they used the term interchangeably but I guess not. Whoops.
Would be helpful to get an error message if you submit a list with letters in it.