Commit Graph

253 Commits

Author SHA1 Message Date
Anna c973542dc5
chore: bump version to 1.6.0 2021-02-25 18:57:03 -05:00
Anna 7afd3268eb
refactor: reduce indent level 2021-02-24 21:02:41 -05:00
Anna 6a7c9ffd4b
feat: add update button escape hatch 2021-02-24 21:01:15 -05:00
Anna be62b6ee9b
chore: increase priority and remove experimental line 2021-02-24 20:59:16 -05:00
Anna 548345aaf4
feat: add model status information 2021-02-24 20:58:47 -05:00
Anna 08efe6991c
chore: remove old test suite
As definitions are no longer being updated, the test suite for them
can be removed. The ML trainer already has statistics on how accurate
it is for both training mode and model creation mode, as well as an
interactive mode to test new messages.
2021-02-24 20:26:16 -05:00
Anna 35faec5fe6
chore: fix modes 2021-02-24 20:23:28 -05:00
Anna cec8adf393
feat: begin removing support for defs
Remove the global section, which filtered Free Company ads and RP
ads. Prevent reporting of messages that were filtered by
definitions. Make the ML mode default and mark definitions mode as
obsolete.
2021-02-24 20:23:28 -05:00
Anna e5d755e42c
feat(data): add more 2021-02-24 20:01:41 -05:00
Anna 3eb7007186
fix(trainer): replace newlines automatically 2021-02-24 20:01:35 -05:00
Anna 870856c8ca
refactor: handle events in their own classes
Also deprecate /prmt and replace with /nosol.
2021-02-24 20:01:12 -05:00
Anna 3be14696c6
feat(data): add more 2021-02-21 15:50:17 -05:00
Anna da6accf432
feat: add "come" and "join" as stop words 2021-02-21 15:50:05 -05:00
Anna 5d08f57134
fix(defs): add restocker rmt 2021-02-21 12:36:05 -05:00
Anna 84644d2806
feat(data): add more data
Also pull out stop words into field.
2021-02-20 19:25:15 -05:00
Anna b36377c16e
feat: add normalisation to pipeline
Add a step to normalise messages to the ML pipeline. This ensures
computed properties run on the raw data (which is actually partially
normalised by the compute context). This prevents properties which
rely on symbols (e.g. "B>") from being unable to work properly when
normalisation happens before they have access to the input.
2021-02-17 21:45:09 -05:00
Anna c65fb94ad6
feat: better handle puncutation
Certain symbols are turned into one space so the model sees multiple
words instead of one. Previously "[RP]Hi" would turn into "RPHi" and
be its own token. Now it turns into "RP" and "Hi", counting as two
tokens. This change increased the model's accuracy.

Also make "18", "http", "https", and LGBT-related words into stop
words (meaning they're ignored). Each of these stop words made the
model more accurate and reduced unwanted bias.

Messages destined for ML are now normalised by the plugin in the same
way the model's input is for training. This should make the results
come closer to expected.
2021-02-17 20:01:34 -05:00
Anna 9ea3cd03f3
chore: set plugin to a higher priority 2021-02-17 18:58:58 -05:00
Anna 7f27a17f4f
feat(data): add more data 2021-02-17 18:58:34 -05:00
Anna 8c7b127f55
feat: ignore private pfs unless told otherwise 2021-02-16 19:41:59 -05:00
Anna d625c7567d
chore: bump version to 1.5.9 2021-02-16 12:18:58 -05:00
Anna beb47b7eb4
feat(data): add more 2021-02-16 12:15:06 -05:00
Anna fd9e9330fc
refactor: use new new syntax 2021-02-16 12:15:00 -05:00
Anna 6033c2ed79
fix: use new Dalamud 2021-02-16 12:14:27 -05:00
Anna 4e182112b4
feat(data): add more data 2021-02-14 15:40:56 -05:00
Anna f4705af8b9
feat: give classifier game process info 2021-02-12 20:13:34 -05:00
Anna c208210a64
feat(data): add more data 2021-02-12 11:56:54 -05:00
Anna eb22c64354
chore: bump version to 1.5.8 2021-02-12 11:56:44 -05:00
Anna 60164ccb23
feat(classifier): check to make sure game is alive 2021-02-12 11:56:28 -05:00
Anna 8313fa20ed
feat(data): more data 2021-02-08 22:34:29 -05:00
Anna ba065bd0cf
feat(data): more data 2021-02-07 12:54:14 -05:00
Anna 43f0d9e902
fix(defs): catch new rmt 2021-02-07 12:53:57 -05:00
Anna 7416023634
feat(data): add more data 2021-02-03 12:16:03 -05:00
Anna 544c661235
fix(defs): make FC less broad 2021-02-01 12:51:35 -05:00
Anna Clemens 568b9c936f
chore: don't process dlls as text 2021-02-01 00:24:42 -05:00
Anna Clemens 09d4c8fe38
feat(data): more 2021-02-01 00:19:51 -05:00
Anna Clemens edc4e32a4d
chore: bump version to 1.5.7 2021-02-01 00:00:34 -05:00
Anna Clemens 76d7d3a583
fix: kill old classifiers 2021-01-31 23:59:04 -05:00
Anna Clemens 60145c181c
chore: run ILRepack on debug builds 2021-01-31 23:58:36 -05:00
Anna Clemens 4241421bed
feat(data): add more data 2021-01-30 20:51:14 -05:00
Anna Clemens 03d0b486fd
fix: dispose model before updating 2021-01-30 20:50:56 -05:00
Anna Clemens 6ba4f5b1a5
chore: fix permissions 2021-01-30 16:10:59 -05:00
Anna Clemens 54987b9fbc
feat(data): add more data 2021-01-30 16:04:37 -05:00
Anna Clemens 2229a0534a
feat: use separate process for classifying 2021-01-30 16:02:37 -05:00
Anna 96c0b27595
feat(data): add more 2021-01-29 22:44:51 -05:00
Anna db007dc0a8
fix: actually serialise ml field 2021-01-29 15:11:08 -05:00
Anna fc0076d239
chore: bump version to 1.5.6
Apparently we were already on 1.5.5.
2021-01-29 15:07:52 -05:00
Anna 6c9f432665
chore: bump version to 1.5.5 2021-01-29 15:03:37 -05:00
Anna ba5214b4de
feat: include if report is ml 2021-01-29 15:03:14 -05:00
Anna e0ba98853f
fix: don't calculate in task 2021-01-29 15:02:19 -05:00