Commit Graph

84 Commits

Author SHA1 Message Date
02d5767c43 feat(data): add more data 2021-03-24 18:37:28 -04:00
12e6d55b20 feat(data): add more data 2021-03-22 18:23:22 -04:00
6f663d582c feat(trainer): ignore word ffxiv 2021-03-22 18:23:08 -04:00
7c9143b211 feat(data): add more 2021-03-19 14:36:10 -04:00
5286cf4b00 feat(data): add more 2021-03-17 12:01:01 -04:00
21c8e86002 feat(data): add more 2021-03-14 20:35:05 -04:00
4685b6167f feat(data): add more data 2021-03-12 12:34:42 -05:00
6417d1b37b feat(data): add more data 2021-03-10 19:40:40 -05:00
d215ed6d60 feat(data): add more 2021-03-06 20:40:41 -05:00
ef0624efde feat(data): add more 2021-03-05 23:01:05 -05:00
20530c6290 feat(trainer): ignore "mounts" 2021-03-05 13:50:16 -05:00
7a8da6df1e feat(data): add more 2021-03-05 02:24:16 -05:00
f96ef4fc1b feat(data): add more 2021-03-04 20:06:26 -05:00
0af172e0a6 feat: stop trying to separate static sub messages 2021-03-04 16:48:11 -05:00
a0e4777741 chore: update csv library 2021-03-03 23:35:57 -05:00
d78f2f6dd7 fix(trainer): remove auto-translate textvalue artifacts 2021-03-03 20:36:53 -05:00
4148df1237 feat(data): add more data 2021-03-03 19:55:54 -05:00
891d4f5aae feat(data): add more data 2021-03-03 18:05:57 -05:00
51ccd9ea0f fix(trainer): clean up some warnings 2021-03-02 23:01:16 -05:00
ce15b07636 fix(trainer): accept more invalid input interactively 2021-03-02 22:58:22 -05:00
4d35c0bac6 feat(data): add more data 2021-03-02 21:16:34 -05:00
81b54c35aa feat: add explainer to test results 2021-03-02 13:25:05 -05:00
1ef5c9f1b5 feat: add community ad filtering
Also add tooltip on filter hover with description.
2021-03-02 13:19:47 -05:00
090c4eff3c feat(trainer): make test output more obvious 2021-03-02 12:53:19 -05:00
fd256722a1 feat(data): add more 2021-03-02 12:44:14 -05:00
348c610ca1 fix(trainer): use correct path for csv 2021-03-02 12:43:47 -05:00
2fd2e54401 feat: add automated model creation 2021-03-02 12:38:30 -05:00
6c9dd9164b feat(trainer): run on net5 and accept csv path
Hopefully will use this to automate model deployment.
2021-03-02 04:52:36 -05:00
65558fa199 feat(data): ignore "blu" and add more 2021-02-26 12:07:19 -05:00
33f5421e79 chore: fix modes 2021-02-24 20:23:28 -05:00
83e6b20333 feat(data): add more 2021-02-24 20:01:41 -05:00
c038adc4e9 fix(trainer): replace newlines automatically 2021-02-24 20:01:35 -05:00
819ac1b457 feat(data): add more 2021-02-21 15:50:17 -05:00
2181649b22 feat: add "come" and "join" as stop words 2021-02-21 15:50:05 -05:00
0dc0c2ef00 feat(data): add more data
Also pull out stop words into field.
2021-02-20 19:25:15 -05:00
c3df0a1f8e feat: add normalisation to pipeline
Add a step to normalise messages to the ML pipeline. This ensures
computed properties run on the raw data (which is actually partially
normalised by the compute context). This prevents properties which
rely on symbols (e.g. "B>") from being unable to work properly when
normalisation happens before they have access to the input.
2021-02-17 21:45:09 -05:00
d00b3b0845 feat: better handle puncutation
Certain symbols are turned into one space so the model sees multiple
words instead of one. Previously "[RP]Hi" would turn into "RPHi" and
be its own token. Now it turns into "RP" and "Hi", counting as two
tokens. This change increased the model's accuracy.

Also make "18", "http", "https", and LGBT-related words into stop
words (meaning they're ignored). Each of these stop words made the
model more accurate and reduced unwanted bias.

Messages destined for ML are now normalised by the plugin in the same
way the model's input is for training. This should make the results
come closer to expected.
2021-02-17 20:01:34 -05:00
fcfe1bb727 feat(data): add more data 2021-02-17 18:58:34 -05:00
f874d8ac37 feat(data): add more 2021-02-16 12:15:06 -05:00
03fe8eecc2 feat(data): add more data 2021-02-14 15:40:56 -05:00
c7c89b33bc feat: give classifier game process info 2021-02-12 20:13:34 -05:00
d921a8cfb0 feat(data): add more data 2021-02-12 11:56:54 -05:00
8eb0507041 feat(data): more data 2021-02-08 22:34:29 -05:00
fb9f5d9b94 feat(data): more data 2021-02-07 12:54:14 -05:00
6985eb2eee feat(data): add more data 2021-02-03 12:16:03 -05:00
Anna
53e0bc3309 feat(data): more 2021-02-01 00:19:51 -05:00
Anna
fdf0849ea6 feat(data): add more data 2021-01-30 20:51:14 -05:00
Anna
d7d6c53c75 chore: fix permissions 2021-01-30 16:10:59 -05:00
Anna
d1228e6bee feat(data): add more data 2021-01-30 16:04:37 -05:00
Anna
87c5602319 feat: use separate process for classifying 2021-01-30 16:02:37 -05:00