Tristan-cs488-tasks - Revision history

Twright09: Final entry

2012-12-12T21:37:30Z

Final entry

← Older revision		Revision as of 21:37, 12 December 2012
Line 1:		Line 1:
	Set of discrete tasks for '''''Schrift''''' (the name of the proposed handwriting recognizer). These notes and more are are kept on paper. Strikethrough tasks are done or no longer necessary, hopefully dated entries will make it clear which. This page might get a little messy.		Set of discrete tasks for '''''Schrift''''' (the name of the proposed handwriting recognizer). These notes and more are are kept on paper. Strikethrough tasks are done or no longer necessary, hopefully dated entries will make it clear which. This page might get a little messy.

	~~I have a digital note page which I access and edit relatively frequently, it can be viewed [https://creative.adobe.com/share/1deefc44-08dd-4012-b090-9f2996828b05 here].~~

	*'''11-26-12''': I tried an openCV example that makes and highlights bounding box and bounding polygon regions, it gave me this [[Media: Surprising.png \| image]]. Suddenly I'm on the recognition step??		*'''11-26-12''': I tried an openCV example that makes and highlights bounding box and bounding polygon regions, it gave me this [[Media: Surprising.png \| image]]. Suddenly I'm on the recognition step??
Line 8:		Line 6:
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).
	*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. ''Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone.''		*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. ''Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone (hello future).''
	* '''12-11-12''': Building the presentation from slides of other presentations in the semester, organizing binaries for the demo. Organizing data in head about NN's and other algorithms. Made the slideshow, went over in my head several times. Implemented space detection between words. ''Post Presentation: '' Just paper writing now, updating figures to match some in the presentation. Including results and discussion section in paper.		* '''12-11-12''': Building the presentation from slides of other presentations in the semester, organizing binaries for the demo. Organizing data in head about NN's and other algorithms. Made the slideshow, went over in my head several times. Implemented space detection between words. ''Post Presentation: '' Just paper writing now, updating figures to match some in the presentation. Including results and discussion section in paper.
			* '''12-12-12''': ''Final Entry'': Printed final draft, had Leif proof read it while I read his. Corrected and updated paper from his feedback and turned in paper ([http://cs.earlham.edu/~twright09/paper.pdf available here]). Project and associated files zipped up and put [http://cs.earlham.edu/~twright09/schrift.zip here]. The project is not accurate in recognizing handwriting and feels incomplete, it's the paper that matters and considering how much I've learned: it's good to be done for now.

	* '''File structuring'''		* '''File structuring'''

Twright09: addendum 12-11-12

2012-12-12T03:32:14Z

addendum 12-11-12

← Older revision		Revision as of 03:32, 12 December 2012
Line 8:		Line 8:
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).
	*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone. ~~I am going to rest for as much as I can afford.~~		*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. ''Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone.''
	* '''12-11-12''': ~~Woke up at around 11, had a fast lunch, building~~ the presentation from slides of other presentations in the semester, organizing binaries for the demo. Organizing data in head about NN's and other algorithms.		* '''12-11-12''': Building the presentation from slides of other presentations in the semester, organizing binaries for the demo. Organizing data in head about NN's and other algorithms. Made the slideshow, went over in my head several times. Implemented space detection between words. ''Post Presentation: '' Just paper writing now, updating figures to match some in the presentation. Including results and discussion section in paper.


Line 30:		Line 30:
	*** push to dynamic array as line[0]</span>		*** push to dynamic array as line[0]</span>
	*'''Word segmentation'''		*'''Word segmentation'''
	** Detect Spaces		** <span style="text-decoration: line-through;">Detect Spaces</span>
	* <span style="text-decoration: line-through;">'''Character segmentation'''		* <span style="text-decoration: line-through;">'''Character segmentation'''
	**openCV historgram test </span>		**openCV historgram test </span>

Twright09 at 17:55, 11 December 2012

2012-12-11T17:55:19Z

← Older revision		Revision as of 17:55, 11 December 2012
Line 9:		Line 9:
	*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).
	*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone. I am going to rest for as much as I can afford.		*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone. I am going to rest for as much as I can afford.
			* '''12-11-12''': Woke up at around 11, had a fast lunch, building the presentation from slides of other presentations in the semester, organizing binaries for the demo. Organizing data in head about NN's and other algorithms.

Twright09: Added entry for tonight. 12/9-10/12

2012-12-11T08:58:15Z

Added entry for tonight. 12/9-10/12

← Older revision		Revision as of 08:58, 11 December 2012
Line 8:		Line 8:
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).
			*'''12-10-12 7pm to 12-11-12 4am''': Characters are fully segmented and in their own box and spot in the array. Need to add space detection still, it won't be something the ANN recognizes, just a flag in the input which will be skipped over and a space written out. Added more input neurons but ANN still outputs goop, I am starting to think it just needs more training points. Notes are scattered everywhere, presentation is in <12 hours and paper due in 36 hours. Entries from here will mostly be for simply documenting the final dash of a CS Senior Capstone. I am going to rest for as much as I can afford.


Line 16:		Line 17:
	* '''Text Scan'''		* '''Text Scan'''
	**<span style="text-decoration: line-through;">OpenCV image import, test threshold filter</span>		**<span style="text-decoration: line-through;">OpenCV image import, test threshold filter</span>
	** Detect holes so that a 'D' or an 'o' does not get recognized as two different characters.		**<span style="text-decoration: line-through;">Detect holes so that a 'D' or an 'o' does not get recognized as two different characters.</span>
	** Algorithm for figuring out correct threshold value. Take a mean of the page color and adjust for that value. Usually 110�10?		** Algorithm for figuring out correct threshold value. Take a mean of the page color and adjust for that value. Usually 110�10?
	** <span style="text-decoration: line-through;">Draw box around where dark is detected, extract that selection. </span>		** <span style="text-decoration: line-through;">Draw box around where dark is detected, extract that selection. </span>

Twright09 at 01:23, 10 December 2012

2012-12-10T01:23:01Z

← Older revision		Revision as of 01:23, 10 December 2012
Line 16:		Line 16:
	* '''Text Scan'''		* '''Text Scan'''
	**<span style="text-decoration: line-through;">OpenCV image import, test threshold filter</span>		**<span style="text-decoration: line-through;">OpenCV image import, test threshold filter</span>
			** Detect holes so that a 'D' or an 'o' does not get recognized as two different characters.
	** Algorithm for figuring out correct threshold value. Take a mean of the page color and adjust for that value. Usually 110�10?		** Algorithm for figuring out correct threshold value. Take a mean of the page color and adjust for that value. Usually 110�10?
	** <span style="text-decoration: line-through;">Draw box around where dark is detected, extract that selection. </span>		** <span style="text-decoration: line-through;">Draw box around where dark is detected, extract that selection. </span>

Twright09: updated 12-9-12

2012-12-10T01:17:11Z

updated 12-9-12

← Older revision		Revision as of 01:17, 10 December 2012
Line 7:		Line 7:
	*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.		*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (~~<20~~ right now ~~due to how I accidentally structured~~ it ~~from the sample OpenCV ANN code mentioned in the last post~~).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (not as many as there should be right now, but adding more clearly sets it closer textual nirvana).

Twright09 at 00:40, 10 December 2012

2012-12-10T00:40:35Z

← Older revision		Revision as of 00:40, 10 December 2012
Line 8:		Line 8:
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).


	* '''File structuring'''		* '''File structuring'''

Twright09: Restructured page, edited last entry

2012-12-10T00:39:54Z

Restructured page, edited last entry

← Older revision		Revision as of 00:39, 10 December 2012
Line 7:		Line 7:
	*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.		*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. It does not give correct output. A 'lot' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).		*'''12-9-12''': I have a working neural network. However it does not give correct output. A ''lot'' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).


	* '''File structuring'''		* '''File structuring'''

Twright09 at 00:37, 10 December 2012

2012-12-10T00:37:05Z

← Older revision		Revision as of 00:37, 10 December 2012
Line 2:		Line 2:

	I have a digital note page which I access and edit relatively frequently, it can be viewed [https://creative.adobe.com/share/1deefc44-08dd-4012-b090-9f2996828b05 here].		I have a digital note page which I access and edit relatively frequently, it can be viewed [https://creative.adobe.com/share/1deefc44-08dd-4012-b090-9f2996828b05 here].

			*'''11-26-12''': I tried an openCV example that makes and highlights bounding box and bounding polygon regions, it gave me this [[Media: Surprising.png \| image]]. Suddenly I'm on the recognition step??
			*'''11-27-12''': The vector that the contours are in are stored in an unusual order, if I sort them by the rectangles bottom left coordinate, a count of lines could be established and I could get the letters into their correct order. Once in order I can detect spaces easily by looking at changes between characters in the x direction. line and word ''segmentation'' are basically kaput, instead I have line and word ''detection''.
			*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.
			*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
			*'''12-9-12''': I have a working neural network. It does not give correct output. A 'lot' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).


	* '''File structuring'''		* '''File structuring'''
	** just doing it, will restructure later.		** <span style="text-decoration: line-through;">just doing it, will restructure later.</span>
	*<span style="text-decoration: line-through;">Image importing		*<span style="text-decoration: line-through;">Image importing
	**Read in jpg image</span>		**Read in jpg image</span>
Line 11:		Line 18:
	** Algorithm for figuring out correct threshold value. Take a mean of the page color and adjust for that value. Usually 110�10?		** Algorithm for figuring out correct threshold value. Take a mean of the page color and adjust for that value. Usually 110�10?
	** <span style="text-decoration: line-through;">Draw box around where dark is detected, extract that selection. </span>		** <span style="text-decoration: line-through;">Draw box around where dark is detected, extract that selection. </span>


	*<span style="text-decoration: line-through;"> '''Line segmentation'''		*<span style="text-decoration: line-through;"> '''Line segmentation'''
Line 20:		Line 26:
	*** create selection between line1 and line2		*** create selection between line1 and line2
	*** push to dynamic array as line[0]</span>		*** push to dynamic array as line[0]</span>
	* ~~<span style="text-decoration: line-through;">~~'''Word segmentation'''		*'''Word segmentation'''
	** ~~Outline algorithm similar to line segmentation</span>~~		** Detect Spaces
	* <span style="text-decoration: line-through;">'''Character segmentation'''		* <span style="text-decoration: line-through;">'''Character segmentation'''
	**openCV historgram test </span>		**openCV historgram test </span>

	*'''11-26-12''': I tried an openCV example that makes and highlights bounding box and bounding polygon regions, it gave me this [[Media: Surprising.png \| image]]. Suddenly I'm on the recognition step??
	*'''11-27-12''': The vector that the contours are in are stored in an unusual order, if I sort them by the rectangles bottom left coordinate, a count of lines could be established and I could get the letters into their correct order. Once in order I can detect spaces easily by looking at changes between characters in the x direction. line and word ''segmentation'' are basically kaput, instead I have line and word ''detection''.
	*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
	*'''12-9-12''': I have a working neural network. It does not give correct output. A 'lot' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).

	* '''Character recognition'''		* '''Character recognition'''
			** Better character recognition, tweak the NN a lot.
	** <span style="text-decoration: line-through;">Figure out a basic neural network</span>		** <span style="text-decoration: line-through;">Figure out a basic neural network</span>
	*** <span style="text-decoration: line-through;">look atOpenCV neural network type</span>		*** <span style="text-decoration: line-through;">look atOpenCV neural network type</span>
	*** <span style="text-decoration: line-through;">I've found some NN tutorials, the implementation of one is what's bothering me.</span>		*** <span style="text-decoration: line-through;">I've found some NN tutorials, the implementation of one is what's bothering me.</span>

Twright09: Added 12-9-12

2012-12-10T00:33:57Z

Added 12-9-12

← Older revision		Revision as of 00:33, 10 December 2012
Line 29:		Line 29:
	*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.		*'''12-2-12''': Messed around with line organization yesterday, didn't make much progress. Read about neural networks a lot too, I will focus on the paper more tonight and the coming days for the next draft.
	*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.		*'''12-8-12''': I'm finally segmenting lines. Now that the letters are in order, I am beginning work on the NN now, I found a small openCV ANN that takes the mean of two numbers, and have been playing around with that. I am uncertain the size of the neural network or how to structure the tests.
			*'''12-9-12''': I have a working neural network. It does not give correct output. A 'lot' of tweaking will need to be done, e.g. more input neurons (right now just 2, # of rows and # of cols of the letter), more training samples (<20 right now due to how I accidentally structured it from the sample OpenCV ANN code mentioned in the last post).

	* '''Character recognition'''		* '''Character recognition'''
	** Figure out a basic neural network		** <span style="text-decoration: line-through;">Figure out a basic neural network</span>
	*** look atOpenCV neural network type		*** <span style="text-decoration: line-through;">look atOpenCV neural network type</span>
	*** <span style="text-decoration: line-through;">I've found some NN tutorials, the implementation of one is what's bothering me.</span>		*** <span style="text-decoration: line-through;">I've found some NN tutorials, the implementation of one is what's bothering me.</span>