| Version at: 14/07/2014, 13:09 vs. version at: 14/07/2014, 22:47 | ||
|---|---|---|
| 1 | 1 | This is a general work log updated <strike>daily</strike> <strike>weekly</strike> sometimes... |
| 2 | 2 | |
| 3 | 3 | ##This week's TODO list: |
| 4 | 4 | |
| 5 | 5 | - make sure code works, fix bugs, breakage |
| 6 | 6 | - work some more on the api: |
| 7 | 7 | - add oauth2 authentication |
| 8 | 8 | - authentication class for python-social-auth integration code |
| 9 | 9 | - start with a skeleton of the js project |
| 10 | 10 | - really deal with permissions, and make a caching backend for it |
| 11 | 11 | - deal with deduplication in preparation for an import script |
| 12 | 12 | - write an import script, should be much easier now that the graphing backends and bulk insert stuff is already there |
| 13 | 13 | - unbreak all those broken tests (only 6 pass at the moment, the schema changed quite a bit and the tests need to be readapted for it) |
| 14 | 14 | |
| 15 | 15 | ##Work log |
| 16 | 16 | |
| 17 | 17 | ###Week 1 19/5 |
| 18 | 18 | |
| 19 | 19 | ####Monday |
| 20 | 20 | - compiled dependencies and tools (sage, git, etc..) |
| 21 | 21 | - set up virtual env |
| 22 | 22 | - set up pytoeba-dev repo/structure |
| 23 | 23 | - setup pytoeba's project structure |
| 24 | 24 | |
| 25 | 25 | ####Tuesday |
| 26 | 26 | - added sentence and link models |
| 27 | 27 | - threw out sage and compiled scipy/numpy |
| 28 | 28 | - explored agpl for graph manipulation |
| 29 | 29 | |
| 30 | 30 | ####Wednesday |
| 31 | 31 | - added log model |
| 32 | 32 | - added correction model |
| 33 | 33 | - added tag models |
| 34 | 34 | - added audio model |
| 35 | 35 | - set up work log |
| 36 | 36 | |
| 37 | 37 | ####Thursday |
| 38 | 38 | - read py.test documentation |
| 39 | 39 | - read django testing documentation |
| 40 | 40 | - wrote a passing test for the sentence manager |
| 41 | 41 | |
| 42 | 42 | ####Friday |
| 43 | 43 | - read "Test Driven development with Python" |
| 44 | 44 | |
| 45 | 45 | ####Saturday |
| 46 | 46 | - Finished the sentence manager |
| 47 | 47 | |
| 48 | 48 | ###Week 2 26/5 |
| 49 | 49 | |
| 50 | 50 | ####Monday/Tuesday |
| 51 | 51 | - added scaffolding/structure for tests and fixtures using py.test |
| 52 | 52 | - added database/form validation tests for: |
| 53 | 53 | - sentence/link models |
| 54 | 54 | - correction model |
| 55 | 55 | - tag models |
| 56 | 56 | - audio models |
| 57 | 57 | - generated coverage reports |
| 58 | 58 | |
| 59 | 59 | ####Wednesday |
| 60 | 60 | - refactored tests and fixtures to be more modular |
| 61 | 61 | - added more tests and expanded the manager some more |
| 62 | 62 | |
| 63 | 63 | ####Thursday/Friday/Saturday |
| 64 | 64 | - N/A |
| 65 | 65 | |
| 66 | 66 | ###Week 3 2/6 |
| 67 | 67 | - python api for CRUD operations on Sentences/Tags/Links |
| 68 | 68 | |
| 69 | 69 | ###Week 4 9/6 |
| 70 | 70 | - User, SocialAccount, Wall, Comment, Message models/managers |
| 71 | 71 | - python-social-auth integration |
| 72 | 72 | |
| 73 | 73 | ###Week 5 16/6 |
| 74 | 74 | - Haystack integration |
| 75 | 75 | - mirroring haystack's searchqueryset api on models with indices |
| 76 | 76 | - Added indices for sentences, comments, messages, wall posts, comments |
| 77 | 77 | |
| 78 | 78 | ###Week 6 23/6 |
| 79 | 79 | - Exposed tastypie model resources (still needs work) |
| 80 | 80 | - Added HTTPBasicAuth/SessionAuth to the api |
| 81 | 81 | - Exposed haystack's auto_query through tastypie |
| 82 | 82 | |
| 83 | 83 | ###Week 7 30/6 |
| 84 | 84 | - fixed various bugs |
| 85 | 85 | - reorganized graphing code into backends (now we're pypy ready) |
| 86 | 86 | - wrote a networkx graphing backend (pure python) |
| 87 | 87 | - reorganized permissions code into backends |
| 88 | 88 | - sql optimizations (bulk upsert, bulk update, etc...) |
| 89 | 89 | - reading ng-book |
| 90 | - major optimizations in the sipy backend, replaced most python code with numpy code | |
| 91 | 90 | - rewrote bulk operations in the python api to utilize the raw sql bulk functions |
| 92 | 91 | - wrote some orm manager integration for iplus1 |
| 93 | 92 | - wrote a tastypie resource for iplus1 |
| 94 | 93 | |
| 95 | 94 | |
| 96 | 95 | ###Week 8 7/7 |
| 96 | - major optimizations in the sipy backend, replaced most python code with numpy code | |
| 97 | 97 | - more sql optimizations, this time in the part of the graphing code that gets the subgraph, more to come (dropping down from orm code to raw sql). |
| 98 | 98 | - hooked most python api to tastypie resource classes, the api should support write functions and other custom read queries now. |
| 99 | 99 | - fixed various bugs in haystack integration, did more testing on it. |
| 100 | 100 | - wrote 2 custom pagination classes for the orm/tasty pie |
| 101 | 101 | - hooked pagination classes to tastypie resources |
| 102 | 102 | - hooked haystack autoquery to relevant tastypie resources (more to come here, it should support as much filtering and ordering as the searchqueryset api supports probably) |
| 103 | 103 | - added outline to a plan to switch from O(n^2) links in the Link table to O(2n) links using connected components. Also plans to support tatodb instead of the link table+ graphing backends |
| 104 | 104 | - wrote cffi bindings for iplus1 following the available python extension. It should probably be fine to run this under pypy as well once jake gets the bindings to work. |
| 105 | 105 | - addressed some of liori's comments on the latest mega patch |
| 106 | 106 | - unbroke most of the schema. shit should be testable again. added migrations. |
| 107 | 107 | |
| 108 | 108 | ###Week 9 14/7 |
| diff view generated by jsdifflib | ||
Version at: 14/07/2014, 13:09
This is a general work log updated <strike>daily</strike> <strike>weekly</strike> sometimes... ##This week's TODO list: - make sure code works, fix bugs, breakage - work some more on the api: - add oauth2 authentication - authentication class for python-social-auth integration code - start with a skeleton of the js project - really deal with permissions, and make a caching backend for it - deal with deduplication in preparation for an import script - write an import script, should be much easier now that the graphing backends and bulk insert stuff is already there - unbreak all those broken tests (only 6 pass at the moment, the schema changed quite a bit and the tests need to be readapted for it) ##Work log ###Week 1 19/5 ####Monday - compiled dependencies and tools (sage, git, etc..) - set up virtual env - set up pytoeba-dev repo/structure - setup pytoeba's project structure ####Tuesday - added sentence and link models - threw out sage and compiled scipy/numpy - explored agpl for graph manipulation ####Wednesday - added log model - added correction model - added tag models - added audio model - set up work log ####Thursday - read py.test documentation - read django testing documentation - wrote a passing test for the sentence manager ####Friday - read "Test Driven development with Python" ####Saturday - Finished the sentence manager ###Week 2 26/5 ####Monday/Tuesday - added scaffolding/structure for tests and fixtures using py.test - added database/form validation tests for: - sentence/link models - correction model - tag models - audio models - generated coverage reports ####Wednesday - refactored tests and fixtures to be more modular - added more tests and expanded the manager some more ####Thursday/Friday/Saturday - N/A ###Week 3 2/6 - python api for CRUD operations on Sentences/Tags/Links ###Week 4 9/6 - User, SocialAccount, Wall, Comment, Message models/managers - python-social-auth integration ###Week 5 16/6 - Haystack integration - mirroring haystack's searchqueryset api on models with indices - Added indices for sentences, comments, messages, wall posts, comments ###Week 6 23/6 - Exposed tastypie model resources (still needs work) - Added HTTPBasicAuth/SessionAuth to the api - Exposed haystack's auto_query through tastypie ###Week 7 30/6 - fixed various bugs - reorganized graphing code into backends (now we're pypy ready) - wrote a networkx graphing backend (pure python) - reorganized permissions code into backends - sql optimizations (bulk upsert, bulk update, etc...) - reading ng-book - major optimizations in the sipy backend, replaced most python code with numpy code - rewrote bulk operations in the python api to utilize the raw sql bulk functions - wrote some orm manager integration for iplus1 - wrote a tastypie resource for iplus1 ###Week 8 7/7 - more sql optimizations, this time in the part of the graphing code that gets the subgraph, more to come (dropping down from orm code to raw sql). - hooked most python api to tastypie resource classes, the api should support write functions and other custom read queries now. - fixed various bugs in haystack integration, did more testing on it. - wrote 2 custom pagination classes for the orm/tasty pie - hooked pagination classes to tastypie resources - hooked haystack autoquery to relevant tastypie resources (more to come here, it should support as much filtering and ordering as the searchqueryset api supports probably) - added outline to a plan to switch from O(n^2) links in the Link table to O(2n) links using connected components. Also plans to support tatodb instead of the link table+ graphing backends - wrote cffi bindings for iplus1 following the available python extension. It should probably be fine to run this under pypy as well once jake gets the bindings to work. - addressed some of liori's comments on the latest mega patch - unbroke most of the schema. shit should be testable again. added migrations. ###Week 9 14/7
version at: 14/07/2014, 22:47
This is a general work log updated <strike>daily</strike> <strike>weekly</strike> sometimes... ##This week's TODO list: - make sure code works, fix bugs, breakage - work some more on the api: - add oauth2 authentication - authentication class for python-social-auth integration code - start with a skeleton of the js project - really deal with permissions, and make a caching backend for it - deal with deduplication in preparation for an import script - write an import script, should be much easier now that the graphing backends and bulk insert stuff is already there - unbreak all those broken tests (only 6 pass at the moment, the schema changed quite a bit and the tests need to be readapted for it) ##Work log ###Week 1 19/5 ####Monday - compiled dependencies and tools (sage, git, etc..) - set up virtual env - set up pytoeba-dev repo/structure - setup pytoeba's project structure ####Tuesday - added sentence and link models - threw out sage and compiled scipy/numpy - explored agpl for graph manipulation ####Wednesday - added log model - added correction model - added tag models - added audio model - set up work log ####Thursday - read py.test documentation - read django testing documentation - wrote a passing test for the sentence manager ####Friday - read "Test Driven development with Python" ####Saturday - Finished the sentence manager ###Week 2 26/5 ####Monday/Tuesday - added scaffolding/structure for tests and fixtures using py.test - added database/form validation tests for: - sentence/link models - correction model - tag models - audio models - generated coverage reports ####Wednesday - refactored tests and fixtures to be more modular - added more tests and expanded the manager some more ####Thursday/Friday/Saturday - N/A ###Week 3 2/6 - python api for CRUD operations on Sentences/Tags/Links ###Week 4 9/6 - User, SocialAccount, Wall, Comment, Message models/managers - python-social-auth integration ###Week 5 16/6 - Haystack integration - mirroring haystack's searchqueryset api on models with indices - Added indices for sentences, comments, messages, wall posts, comments ###Week 6 23/6 - Exposed tastypie model resources (still needs work) - Added HTTPBasicAuth/SessionAuth to the api - Exposed haystack's auto_query through tastypie ###Week 7 30/6 - fixed various bugs - reorganized graphing code into backends (now we're pypy ready) - wrote a networkx graphing backend (pure python) - reorganized permissions code into backends - sql optimizations (bulk upsert, bulk update, etc...) - reading ng-book - rewrote bulk operations in the python api to utilize the raw sql bulk functions - wrote some orm manager integration for iplus1 - wrote a tastypie resource for iplus1 ###Week 8 7/7 - major optimizations in the sipy backend, replaced most python code with numpy code - more sql optimizations, this time in the part of the graphing code that gets the subgraph, more to come (dropping down from orm code to raw sql). - hooked most python api to tastypie resource classes, the api should support write functions and other custom read queries now. - fixed various bugs in haystack integration, did more testing on it. - wrote 2 custom pagination classes for the orm/tasty pie - hooked pagination classes to tastypie resources - hooked haystack autoquery to relevant tastypie resources (more to come here, it should support as much filtering and ordering as the searchqueryset api supports probably) - added outline to a plan to switch from O(n^2) links in the Link table to O(2n) links using connected components. Also plans to support tatodb instead of the link table+ graphing backends - wrote cffi bindings for iplus1 following the available python extension. It should probably be fine to run this under pypy as well once jake gets the bindings to work. - addressed some of liori's comments on the latest mega patch - unbroke most of the schema. shit should be testable again. added migrations. ###Week 9 14/7