Parthenia, would you believe I think hand carding and dealing with rollogs to be the hardest part of spinning? I know your first spinning attempts may not look like much, but think of them as "novelty" yarn. It won't be long before you won't be able to duplicate that look for anything!
The Ashford book is probably your best bet for now, since you have an Ashford. You might try to get the Alden Amos book through your library before you buy it since it's really pricy ($40.00). Another book you might want to consider, though, is Essentials of Handspinning by Mabel Ross. I haven't seen that book either, but I've watched one of her videos on advanced spinning techniques and I have one of her other books and they are wonderful!!!
Also, try and find a weaving or spinning guild in your area. Generally, those people are really anxious to help a new fiber person! And you can make some really great fiber friends in the process.
Good luck and let me know if I can help!