| Version at: 14/07/2014, 12:52 vs. version at: 14/07/2014, 12:57 | ||
|---|---|---|
| 1 | 1 | This is a general work log updated <strike>daily</strike> <strike>weekly</strike> sometimes... |
| 2 | 2 | |
| 3 | 3 | ##This week's TODO list: |
| 4 | 4 | |
| 5 | 5 | - make sure code works, fix bugs, breakage |
| 6 | 6 | - work some more on the api: |
| 7 | 7 | - add oauth2 authentication |
| 8 | - authentication class for python-social-auth integration code | |
| 8 | 9 | - start with a skeleton of the js project |
| 9 | ||
| 10 | - really deal with permissions, and make a caching backend for it | |
| 11 | - deal with deduplication in preparation for an import script | |
| 12 | - write an import script, should be much easier now that the graphing backends and bulk insert stuff is already there | |
| 10 | 13 | |
| 11 | 14 | ##Work log |
| 12 | 15 | |
| 13 | 16 | ###Week 1 19/5 |
| 14 | 17 | |
| 15 | 18 | ####Monday |
| 16 | 19 | - compiled dependencies and tools (sage, git, etc..) |
| 17 | 20 | - set up virtual env |
| 18 | 21 | - set up pytoeba-dev repo/structure |
| 19 | 22 | - setup pytoeba's project structure |
| 20 | 23 | |
| 21 | 24 | ####Tuesday |
| 22 | 25 | - added sentence and link models |
| 23 | 26 | - threw out sage and compiled scipy/numpy |
| 24 | 27 | - explored agpl for graph manipulation |
| 25 | 28 | |
| 26 | 29 | ####Wednesday |
| 27 | 30 | - added log model |
| 28 | 31 | - added correction model |
| 29 | 32 | - added tag models |
| 30 | 33 | - added audio model |
| 31 | 34 | - set up work log |
| 32 | 35 | |
| 33 | 36 | ####Thursday |
| 34 | 37 | - read py.test documentation |
| 35 | 38 | - read django testing documentation |
| 36 | 39 | - wrote a passing test for the sentence manager |
| 37 | 40 | |
| 38 | 41 | ####Friday |
| 39 | 42 | - read "Test Driven development with Python" |
| 40 | 43 | |
| 41 | 44 | ####Saturday |
| 42 | 45 | - Finished the sentence manager |
| 43 | 46 | |
| 44 | 47 | ###Week 2 26/5 |
| 45 | 48 | |
| 46 | 49 | ####Monday/Tuesday |
| 47 | 50 | - added scaffolding/structure for tests and fixtures using py.test |
| 48 | 51 | - added database/form validation tests for: |
| 49 | 52 | - sentence/link models |
| 50 | 53 | - correction model |
| 51 | 54 | - tag models |
| 52 | 55 | - audio models |
| 53 | 56 | - generated coverage reports |
| 54 | 57 | |
| 55 | 58 | ####Wednesday |
| 56 | 59 | - refactored tests and fixtures to be more modular |
| 57 | 60 | - added more tests and expanded the manager some more |
| 58 | 61 | |
| 59 | 62 | ####Thursday/Friday/Saturday |
| 60 | 63 | - N/A |
| 61 | 64 | |
| 62 | 65 | ###Week 3 2/6 |
| 63 | 66 | - python api for CRUD operations on Sentences/Tags/Links |
| 64 | 67 | |
| 65 | 68 | ###Week 4 9/6 |
| 66 | 69 | - User, SocialAccount, Wall, Comment, Message models/managers |
| 67 | 70 | - python-social-auth integration |
| 68 | 71 | |
| 69 | 72 | ###Week 5 16/6 |
| 70 | 73 | - Haystack integration |
| 71 | 74 | - mirroring haystack's searchqueryset api on models with indices |
| 72 | 75 | - Added indices for sentences, comments, messages, wall posts, comments |
| 73 | 76 | |
| 74 | 77 | ###Week 6 23/6 |
| 75 | 78 | - Exposed tastypie model resources (still needs work) |
| 76 | 79 | - Added HTTPBasicAuth/SessionAuth to the api |
| 77 | 80 | - Exposed haystack's auto_query through tastypie |
| 78 | 81 | |
| 79 | 82 | ###Week 7 30/6 |
| 80 | 83 | - fixed various bugs |
| 81 | 84 | - reorganized graphing code into backends (now we're pypy ready) |
| 82 | 85 | - wrote a networkx graphing backend (pure python) |
| 83 | 86 | - reorganized permissions code into backends |
| 84 | 87 | - sql optimizations (bulk upsert, bulk update, etc...) |
| 85 | 88 | - reading ng-book |
| 86 | 89 | - major optimizations in the sipy backend, replaced most python code with numpy code |
| 87 | 90 | - rewrote bulk operations in the python api to utilize the raw sql bulk functions |
| 88 | - wrote orm manager integration for iplus1 | |
| 91 | - wrote some orm manager integration for iplus1 | |
| 89 | 92 | - wrote a tastypie resource for iplus1 |
| 90 | 93 | |
| 91 | 94 | |
| 92 | 95 | ###Week 8 7/7 |
| 93 | 96 | - more sql optimizations, this time in the part of the graphing code that gets the subgraph, more to come (dropping down from orm code to raw sql). |
| 94 | - hooked most python api to tasty pie resource classes, the api should support write functions and other custom read queries now. | |
| 97 | - hooked most python api to tastypie resource classes, the api should support write functions and other custom read queries now. | |
| 95 | 98 | - fixed various bugs in haystack integration, did more testing on it. |
| 96 | 99 | - wrote 2 custom pagination classes for the orm/tasty pie |
| 97 | 100 | - hooked pagination classes to tastypie resources |
| 98 | 101 | - hooked haystack autoquery to relevant tastypie resources (more to come here, it should support as much filtering and ordering as the searchqueryset api supports probably) |
| 99 | 102 | - added outline to a plan to switch from O(n^2) links in the Link table to O(2n) links using connected components. Also plans to support tatodb instead of the link table+ graphing backends |
| 100 | 103 | - wrote cffi bindings for iplus1 following the available python extension. It should probably be fine to run this under pypy as well once jake gets the bindings to work. |
| 101 | 104 | - addressed some of liori's comments on the latest mega patch |
| 102 | 105 | |
| 103 | 106 | ###Week 9 14/7 |
| diff view generated by jsdifflib | ||
Version at: 14/07/2014, 12:52
This is a general work log updated <strike>daily</strike> <strike>weekly</strike> sometimes... ##This week's TODO list: - make sure code works, fix bugs, breakage - work some more on the api: - add oauth2 authentication - start with a skeleton of the js project ##Work log ###Week 1 19/5 ####Monday - compiled dependencies and tools (sage, git, etc..) - set up virtual env - set up pytoeba-dev repo/structure - setup pytoeba's project structure ####Tuesday - added sentence and link models - threw out sage and compiled scipy/numpy - explored agpl for graph manipulation ####Wednesday - added log model - added correction model - added tag models - added audio model - set up work log ####Thursday - read py.test documentation - read django testing documentation - wrote a passing test for the sentence manager ####Friday - read "Test Driven development with Python" ####Saturday - Finished the sentence manager ###Week 2 26/5 ####Monday/Tuesday - added scaffolding/structure for tests and fixtures using py.test - added database/form validation tests for: - sentence/link models - correction model - tag models - audio models - generated coverage reports ####Wednesday - refactored tests and fixtures to be more modular - added more tests and expanded the manager some more ####Thursday/Friday/Saturday - N/A ###Week 3 2/6 - python api for CRUD operations on Sentences/Tags/Links ###Week 4 9/6 - User, SocialAccount, Wall, Comment, Message models/managers - python-social-auth integration ###Week 5 16/6 - Haystack integration - mirroring haystack's searchqueryset api on models with indices - Added indices for sentences, comments, messages, wall posts, comments ###Week 6 23/6 - Exposed tastypie model resources (still needs work) - Added HTTPBasicAuth/SessionAuth to the api - Exposed haystack's auto_query through tastypie ###Week 7 30/6 - fixed various bugs - reorganized graphing code into backends (now we're pypy ready) - wrote a networkx graphing backend (pure python) - reorganized permissions code into backends - sql optimizations (bulk upsert, bulk update, etc...) - reading ng-book - major optimizations in the sipy backend, replaced most python code with numpy code - rewrote bulk operations in the python api to utilize the raw sql bulk functions - wrote orm manager integration for iplus1 - wrote a tastypie resource for iplus1 ###Week 8 7/7 - more sql optimizations, this time in the part of the graphing code that gets the subgraph, more to come (dropping down from orm code to raw sql). - hooked most python api to tasty pie resource classes, the api should support write functions and other custom read queries now. - fixed various bugs in haystack integration, did more testing on it. - wrote 2 custom pagination classes for the orm/tasty pie - hooked pagination classes to tastypie resources - hooked haystack autoquery to relevant tastypie resources (more to come here, it should support as much filtering and ordering as the searchqueryset api supports probably) - added outline to a plan to switch from O(n^2) links in the Link table to O(2n) links using connected components. Also plans to support tatodb instead of the link table+ graphing backends - wrote cffi bindings for iplus1 following the available python extension. It should probably be fine to run this under pypy as well once jake gets the bindings to work. - addressed some of liori's comments on the latest mega patch ###Week 9 14/7
version at: 14/07/2014, 12:57
This is a general work log updated <strike>daily</strike> <strike>weekly</strike> sometimes... ##This week's TODO list: - make sure code works, fix bugs, breakage - work some more on the api: - add oauth2 authentication - authentication class for python-social-auth integration code - start with a skeleton of the js project - really deal with permissions, and make a caching backend for it - deal with deduplication in preparation for an import script - write an import script, should be much easier now that the graphing backends and bulk insert stuff is already there ##Work log ###Week 1 19/5 ####Monday - compiled dependencies and tools (sage, git, etc..) - set up virtual env - set up pytoeba-dev repo/structure - setup pytoeba's project structure ####Tuesday - added sentence and link models - threw out sage and compiled scipy/numpy - explored agpl for graph manipulation ####Wednesday - added log model - added correction model - added tag models - added audio model - set up work log ####Thursday - read py.test documentation - read django testing documentation - wrote a passing test for the sentence manager ####Friday - read "Test Driven development with Python" ####Saturday - Finished the sentence manager ###Week 2 26/5 ####Monday/Tuesday - added scaffolding/structure for tests and fixtures using py.test - added database/form validation tests for: - sentence/link models - correction model - tag models - audio models - generated coverage reports ####Wednesday - refactored tests and fixtures to be more modular - added more tests and expanded the manager some more ####Thursday/Friday/Saturday - N/A ###Week 3 2/6 - python api for CRUD operations on Sentences/Tags/Links ###Week 4 9/6 - User, SocialAccount, Wall, Comment, Message models/managers - python-social-auth integration ###Week 5 16/6 - Haystack integration - mirroring haystack's searchqueryset api on models with indices - Added indices for sentences, comments, messages, wall posts, comments ###Week 6 23/6 - Exposed tastypie model resources (still needs work) - Added HTTPBasicAuth/SessionAuth to the api - Exposed haystack's auto_query through tastypie ###Week 7 30/6 - fixed various bugs - reorganized graphing code into backends (now we're pypy ready) - wrote a networkx graphing backend (pure python) - reorganized permissions code into backends - sql optimizations (bulk upsert, bulk update, etc...) - reading ng-book - major optimizations in the sipy backend, replaced most python code with numpy code - rewrote bulk operations in the python api to utilize the raw sql bulk functions - wrote some orm manager integration for iplus1 - wrote a tastypie resource for iplus1 ###Week 8 7/7 - more sql optimizations, this time in the part of the graphing code that gets the subgraph, more to come (dropping down from orm code to raw sql). - hooked most python api to tastypie resource classes, the api should support write functions and other custom read queries now. - fixed various bugs in haystack integration, did more testing on it. - wrote 2 custom pagination classes for the orm/tasty pie - hooked pagination classes to tastypie resources - hooked haystack autoquery to relevant tastypie resources (more to come here, it should support as much filtering and ordering as the searchqueryset api supports probably) - added outline to a plan to switch from O(n^2) links in the Link table to O(2n) links using connected components. Also plans to support tatodb instead of the link table+ graphing backends - wrote cffi bindings for iplus1 following the available python extension. It should probably be fine to run this under pypy as well once jake gets the bindings to work. - addressed some of liori's comments on the latest mega patch ###Week 9 14/7