Incorrect emote indexes in messages with the "flags" attribute

BarryCarlyon · August 9, 2020, 11:26am

flags is a undocumented tag. We don’t know what it does.

Undocumented Tags can be changed or added at any time.

Similar reported issue

github.com/twitchdev/issues

Emote index sometimes out of bounds for given message

opened 07:43AM - 07 May 20 UTC

RAnders00

product: docs product: chat ticketed

**Brief description** My service sometimes receives messages which have an `emo…te=` tag that specifies indices that go out of bounds for the given message string. Examples: - `@badge-info=subscriber/3;badges=subscriber/3;color=#0000FF;display-name=Linkoping;emotes=25:40-44;flags=17-26:S.6;id=744f9c58-b180-4f46-bd9e-b515b5ef75c1;mod=0;room-id=188442366;subscriber=1;tmi-sent-ts=1566335866017;turbo=0;user-id=91673457;user-type= :linkoping!linkoping@linkoping.tmi.twitch.tv PRIVMSG #queenqarro :Då kan du begära skadestånd och förtal Kappa` Compare that to the message that is created when I send the exact same message to chat myself: `@badge-info=subscriber/20;badges=moderator/1,subscriber/12;color=#19E6E6;display-name=randers;emotes=25:39-43;flags=;id=3ea97f01-abb2-4acf-bdb8-f52e79cd0324;mod=1;room-id=11148817;subscriber=1;tmi-sent-ts=1588837097115;turbo=0;user-id=40286300;user-type=mod :randers!randers@randers.tmi.twitch.tv PRIVMSG #pajlada :Då kan du begära skadestånd och förtal Kappa` In the bugged message, `emotes=25:40-44` specifies Kappa to be at index 40 - 44, but that is out of range for that string. On the message I sent myself, it's `emotes=25:39-43`, which is correct. The example message here has 44 characters (so the characters can be indexed with the indices 0 to 43) - end index 44 is exactly one out of bounds. More examples of messages that fail to parse correctly: - `@badge-info=;badges=moderator/1,partner/1;color=#5B99FF;display-name=StreamElements;emotes=86:30-39/822112:73-79;flags=22-27:S.5;id=03c3eec9-afd1-4858-a2e0-fccbf6ad8d1a;mod=1;room-id=506590738;subscriber=0;tmi-sent-ts=1588638345928;turbo=0;user-id=100135110;user-type=mod :streamelements!streamelements@streamelements.tmi.twitch.tv PRIVMSG #nobru :╔ACTION A LOJA AINDA NÃO ESTÁ PRONTA BibleThump , AGUARDE... NOVIDADES EM BREVE FortOne╔` - `@badge-info=subscriber/1;badges=subscriber/0;color=;display-name=jhoelsc;emotes=301683486:46-58,60-72,74-86/301683544:88-100;flags=0-4:S.6;id=1f1afcdd-d94c-4699-b35f-d214deb1e11a;mod=0;room-id=167189231;subscriber=1;tmi-sent-ts=1588640587462;turbo=0;user-id=505763008;user-type= :jhoelsc!jhoelsc@jhoelsc.tmi.twitch.tv PRIVMSG #staryuuki :pensé que no habría directo que bueno que si staryuukiLove staryuukiLove staryuukiLove staryuukiBits` **How to reproduce** Join a lot of channels, and check each message for this condition. (emote end index >= message length) **Expected behavior** The emote indices are correct. **Screenshots** I believe I have even seen an effect of this when using normal chat, not using the Chat API. The emotes will be misplaced over the text, with the space next to them being consumed and one letter being left standing there. **Additional context or questions** I suspect this has to do with the accents/unicode characters people used in these messages. I have yet to see a malformed emotes tag without accents somewhere in the message. Also note that I'm really only able to detect messages where the emote tag overruns at the end. There's probably a lot more malformed messages floating around that have the misaligned emote tag for an emote not at the end of the message. Also, https://github.com/robotty/dank-twitch-irc/issues/22 - Linked issue.