Random Vectors » Tools http://randomvectors.com I hope some people will find it to their advantage to decipher all this mess. Évariste Galois Mon, 26 Oct 2015 15:45:17 +0000 en-US hourly 1 Audio Analysis with WaveSurfer http://randomvectors.com/blog/2011/03/07/audio-analysis-with-wavesurfer/ http://randomvectors.com/blog/2011/03/07/audio-analysis-with-wavesurfer/#comments Mon, 07 Mar 2011 19:49:24 +0000 http://randomvectors.com/?p=216 Wave Surfer is under active development again and I am delighted.

http://sourceforge.net/projects/wavesurfer/

If you want a complete tool kit for analysis of audio this is it. The system runs on Windows, OSX and  Linux what more could you ask for? Precompiled binaries are available as well as source code.

Wave Surfer Sample Screen

Sample Screen

]]>
http://randomvectors.com/blog/2011/03/07/audio-analysis-with-wavesurfer/feed/ 0
Dell outlet http://randomvectors.com/blog/2011/03/04/dell-outlet-the-best-value-in-computing/ http://randomvectors.com/blog/2011/03/04/dell-outlet-the-best-value-in-computing/#comments Fri, 04 Mar 2011 21:09:22 +0000 http://randomvectors.com/?p=65 If you haven’t checked out the Dell outlet I would recommend that you do. For laptops you can get a slightly older technology laptop for around $300. A nice deal for what is quickly becoming a disposable item for some people. After one purchase you will start receiving coupons for 15-25% off.

My personal favorite is the Inspiron 15-1545 for  $379

The real values are the larger storage devices and servers. In many cases these are effectively 1K to half price. And well worth a look if you are in the market for a low cost dedicated web server or compute server. The other large advantage is that the server is already built and ready to ship substantially reducing the time that you need to wait to get your equipment.

You get the same warranty as a new computer which makes it even more attractive. And you can call yourself green because you recycled some older equipment.

]]>
http://randomvectors.com/blog/2011/03/04/dell-outlet-the-best-value-in-computing/feed/ 0
Dailing in the Atiz DIY Scanner http://randomvectors.com/blog/2011/03/04/dailing-in-the-atiz-diy-scanner/ http://randomvectors.com/blog/2011/03/04/dailing-in-the-atiz-diy-scanner/#comments Fri, 04 Mar 2011 16:32:14 +0000 http://randomvectors.com/?p=49 My modifications to the Atiz DIY scanner to optimize image quality and speed.

As a rabid scanner and collector of books, it quickly became obvious that a flatbed scanner was not going to be cost effective. Reviewing the options, I decided upon the Atiz DIY Scanner. Two features where important to me. Speed the Atiz uses Canon DSLR cameras to quickly capture the pages of the book and this naturally leads to the next feature which is that the Atiz is also Non Destructive.  This means that you do not have to cut the binding from the book. This was especially important due to my interest in books that where out of copywrite.

Once received building the scanner itself took about an hour. Well time to plug it in and start scanning. Well if it was only that easy.

Choice of lens

The recommended lens setup is the Canon 50mm fixed focus lens. This is probably my favorite photography lens due to its rather large aperture (light gathering capabilities) and price. In some cases less then $50. Typically $80 retail. A great lens just not great for my choice of camera. I chose the Canon Xsi which at the time was the highest resolution camera from Canon available at 12 mega pixels. This equated to just less than 300 dpi for the documents I was scanning. Perfect for OCR. Well the CMOS sensor on the low consumer grade cameras (i.e. the ones less then $1000) is not a full 35mm sensor but a truncated dimension. This turned my 50mm lens into an (50mm x 1.6=) 80mm lens. There simply is not enough travel on the camera mounts to account for this conversion factor without cropping the document pages. I could indeed get the entire page on the scanner but I had to move the camera so far back that the actual page was only a fraction of the usable image space. Effectively reducing my DPI measure, which was not the objective. So off to choose a different lens. At this point, my total cost for the system is about $10,000 so price is an object at this point I ended up choosing the Tamron 55-200mm zoom lens. With this setup, I can move the camera far enough back and zoom onto the page to capture the page and fill in the entire usable image space. There is some pin holing on the images but most modern OCR system can handle this. This use of the zoom lens actually makes the book setup much faster then with a fixed lens and I can optically magnify books that are smaller formats. (In some cases, I have found valuable dictionaries that are less then 5 inches tall)

Adjusting the self-centering mechanism.

After switching out the lenses, I found that the self-centering mechanism was not functioning properly. As you move through the book, the spine should self-center saving you readjustment of the cameras. This needed to be raised a bit to avoid binding on the lower support beam. This is accomplished by loosening the bolts under the bottom book support.

Self Centering Enlarged

Centering the cameras

The camera mounts are not self-centering. Therefore, you need to adjust the angle using a long yardstick or other measuring device. I simply lay it across the book mounts and take photos until the center measurement is in the center of the captured image and both images from my right and left camera appear at the same scale. I would have preferred to use a level but the Canon cameras do not have a level back plane on which to mount the level.

Overhead lighting

Capturing of books goes smoothly until I find an older book, which has the text rather close to the spine. It became obvious that I have some major glare issues where the seam of the clear scanner plate is bent at at 45 degree angle. This creates a concave surface that is guaranteed to shine the overheard light right into the camera. At first, I assume I can simply polarize the light source and put a linear polarizer on the camera. This does not work in practice, as the auto focus mechanism will fail to work if you use a polarizing filter. So removing the lighting from the top of the scanner was required. At first, I simply mounted a few home depot florescent lights on the wall that the scanner was located. This worked very well and eliminated the glare issue. Once I performed more OCR the gradient of the lighting across the page while not visible to the human eye was creating artifacts for the OCR system. I then mounted linear LED lights on both sides of the scanner just above my head and replaced the florescent lights on the far wall. [photo] This works well but can be dark for color photography. Luckily, I am scanning only books with text in them.

Offset Lights

LED Lighting Closeup

LED Lighting Closeup

 

LED Mounting Method

LED Mounting Method

Wood Clamp Stablizer

Wood Clamp used to Stablize LEDs

Plastic Clamps Closeup

Plastic Clamps Closeup

Stick Holding LED lighting Clamps to Shade

Stick Holding LED lighting Clamps to Shade

 

 

Protecting your Camera

To get the correct angle on the cameras I resorted to placing a few business cards at the bottom of the camera where it pressed against the camera mount. This allows me to adjust slighting the angle of the camera. This worked out great until I loosened on of the cameras too much and it dropped on the platen. Luckily the camera and platen where unharmed. Now I have some old shoelaces holding the camera up in addition to the camera mount. Stupid looking but better safe then sorry. [photo]

Extending the shroud

I extended the original shroud to the tabletop to avoid glare from the white colored wall at the far end of the scanner.

Renfrew tape is your friend

Some of the wires I used where white for the LED lighting. Simple renfrew tape available from any sporting store can easily recolor the black.

Software tweaks

The DIY software is a bit buggy but usable. However, in some cases they get out of sync with the client capture system. In this case, it is an easy matter to copy the Canon SDK (.dll files) to the home directory of the client software to allow control of new cameras.

I have had issues with memory leaks and race conditions that forced me to restart the capture software to scan large books. Some of these errors are random and are perhaps actually in the Canon SDK themselves. This does not have much of an effect on my actual processing of documents other then it is annoying.

In the future, I will probably be writing my own capture software to avoid these issues. I already have an imagej script to post process images.

Would I recommend you buy one of these? I am not sure. For the money, it is effective. Like all things automated, it is a bit finicky and less then you would expect for the price. However, given the alternatives for me it is worth it.

]]>
http://randomvectors.com/blog/2011/03/04/dailing-in-the-atiz-diy-scanner/feed/ 3
Liquid Web http://randomvectors.com/blog/2011/03/04/liquidweb-heroic-support-for-the-most-part/ http://randomvectors.com/blog/2011/03/04/liquidweb-heroic-support-for-the-most-part/#comments Fri, 04 Mar 2011 15:46:37 +0000 http://randomvectors.com/?p=72 Liquid web is my new favorite web hosting company.

After using some of the big names in hosting including Verio and Dell, I feel I am pretty informed about what to expect from a hosting company. Moreover, after being hacked to the point of feeling violated and foolish I have come to respect the value of a support team that takes multi level security to heart.

To be fair none of my other hosting companies was responsible for my hacking issues. I would blame those on wordpress, joomula and Zen cart. On the other hand, perhaps the fact that you need to update these packages and follow the instructions to the letter to avoid issues. That said it would be cost prohibitive to rewrite these packages and perhaps in the short run even more insecure.

The bottom line is that without multiple levels of protection any software package is a target for hackers.

Proactive Support

Liquid web not only monitors the usual port 80 and other services but profiles CPU and memory usage. This was brought home to me when they sent me a message that my apache server was using more memory then it should be. The reason was that my site was a low bandwidth site and the server was spawning off too many children to service only a few web page requests.

How many hosting companies do you know that would send you a message like the one below?

<strong><em>Our Sonar Server Health monitoring alerted me to high load and/or memory use</em></strong>
<strong><em> on your server today. We were able to log in and prevent the server from</em></strong>
<strong><em> crashing and requiring a reboot. The following actions were taken to prevent</em></strong>
<strong><em> the crash:</em></strong>
<strong><em> </em></strong>
<strong><em> enabled apache's piped logging to address a memory leak issue as described</em></strong>
<strong><em> here: <a href="http://kb.liquidweb.com/how-and-why-enabling-apaches-piped-logging/" target="_blank">http://kb.liquidweb.com/how-and-why-enabling-apaches-piped-logging/</a></em></strong>

Bottom line we found a problem and fixed it without having to bother you. Now that is good business!

Responsive Customer support

I have found their support to be prompt and easily within their advertised response time of 30 minutes. I have had them reset my IP address when the firewall has automatically blocked me and had then install PHP packages with a minimum of fuss. I would have to say they are the most responsive in this regard.

I have asked their first line of support some tough questions about configuration and the like and can tell that they also have supervisors monitoring the communications because sometime they will enter the email stream to provide clarification on information I am requesting.

In addition, when they fix something they usually tell me what files they changed or what scripts they ran. This creates a smarter end users and empowers me to fix issues myself if need be.

Excellent Security (for the most part)

The good:

They have a very good security posture provided by mod_apache for the most part but also use a system configuration that is accredited for credit cards transactions. This provides a baseline for you to work with.

Here is an example of something I did not expect from them regards a scan of my current server modifications.

<strong><em>Note: If this is the first time you received this mail, it contains the history for the entire month so far.

 Below are the recently upload scripts that contain code to send email.  You may wish to inspect them to ensure they are not sending out SPAM.

</em></strong>In this case, the change was known but this would be an excellent tip  off if there were hacker activities that I did not know about.

The bad:

The only real issue I had with them are some strange default settings for the cpanel.

For my virtual private server anonymous ftp was turned on by default! Whoops I would not have expected that. For some reason the site name was blocked but the IP address was not (this is handled at the WMH panel level ). Which leads to a confusing sense of security that you actually turned it off in the cpanel.
That and the sometimes over aggressive SQL injection filtering are the only real annoyances. When editing this article the mod_apache filter broke my request because I had an entry like:

There are nice things to s elect f rom. (that took a bit of investigating)

]]>
http://randomvectors.com/blog/2011/03/04/liquidweb-heroic-support-for-the-most-part/feed/ 2