logo
Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

2 Pages12>
Options
Go to last post Go to first unread
longhair4277  
#1 Posted : Tuesday, December 5, 2006 8:35:41 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

What is the file format of the symbol data base ( SymbolDatabase10.dta) that is downloaded from Equis? I would like to know so that I can update it as the stock symols change. I have a macro's build it Excel to determine the old and new symbols for the stock from a PDF that I create from the downloaded report. Now I just need to update the SymbolDatabase10.dta file and recreate the stocks.

Thanks

Dean

Justin  
#2 Posted : Wednesday, December 6, 2006 10:54:15 AM(UTC)
Justin

Rank: Advanced Member

Groups: Registered, Registered Users, Unverified Users
Joined: 9/13/2004(UTC)
Posts: 673
Location: Salt Lake City, UT

This is a proprietary format. The only way to add to this is through File-->Open-->Tools-->New Symbol or you can right click on an existing symbol in the symbol lookup and choose Properties to edit the symbol.
longhair4277  
#3 Posted : Wednesday, December 6, 2006 12:17:22 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

Pyradius wrote:
This is a proprietary format.

Why so? What would be the harm in being uable to update your symbols automatically. It SHOULD already be part of MS10. Is there so sort of "developer" kit that would contain this?

Thanks Dean

longhair4277  
#4 Posted : Wednesday, December 6, 2006 1:42:28 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

After I got my head out of the "personal use only box" I can see why you would not release it. I was wanting it solely for my own use. Whereas if you released it, it would surely be used for monetary gain. Sorry if I had a "tone" in my previous message.

Dean

Branden Russell  
#5 Posted : Wednesday, December 6, 2006 2:57:16 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

Why would you need to update the symboldatabase.dta?
We do that every month for you.

Select Update Symbol Database from the Tools menu in the DownLoader.

As you have already found, but I'll post here anyway to help others, I have thought about doing a utility that would use the updated symboldatabase.dta you get from us to keep your local files current.
That thread is http://forum.equis.com/forums/thread/22041.aspx

longhair4277  
#6 Posted : Wednesday, December 6, 2006 4:26:13 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

Branden Russell wrote:

Why would you need to update the symboldatabase.dta?
We do that every month for you.

I started this thread before I found the other thread we are discussing in.

My plan was to update the symboldatabase and then use downloader to add the stocks that were missing (or missing because of name changes) as it appears the downloader will no add a symbol that already exists.

It was a crude and rude idea that would work, but with no grace at all. Would have saved some time, but not near the time that what your proposing will.

Dean

Branden Russell  
#7 Posted : Wednesday, December 6, 2006 4:39:03 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

I understand it was before the other thread, I'm just still having trouble following your idea.

The symboldatabase10.dta is the symbol file you get from us. It has all the current securities in it (at least when it was created each month).
You shouldn't need to add or remove symbols from it, you would use it (through the DownLoader) to create local securities and keep your local database up to date.

Am I misunderstanding what you're trying to do with it?
I'm not sure if you were planning to read through it and get the current symbols, if you're thinking that's you're local database, or something else.

longhair4277  
#8 Posted : Wednesday, December 6, 2006 11:43:33 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26


I have determined 2 ways to create secuirty files from symbols: Use a .SYM file or use the symboldatabase from you. Problem with your file, that it only comes every month or so, and it can be a a ways off what is current.

So far, from what I can tell, the fastest way to create the security files (from symbols) is using the downloader and importing a .SYM file, but the .sym file does not have "exchange" name ino in it.

I personally use a folder for each of the exchanges (ASE, NYSE,NASDAQ,OTC,CDNX,TSX and the 2 BB variants) that way, it does I have also determined that the downloader will not create security files for a symbol that already exists.

My final thought was to do my method of getting name changes (symbols) from the download log, create .sym files (uniquely named for each of my exchange foder) from the SymbolDatabase file, update the .sym files with the changes, then use the downloader with the .sym files to create the new files, and eventually remove the old symbols (manually)

Not a simple process, but better than one at a time. I had figured I would do it every weekend.

I know that the symboldatabase.dta file is NOT my local data.

Ideally, I would determine the symbols in each of my folders and directly rename them their.I just don't know how to do that, and from what you tell me, the file formats are private and I couldn't do it.

Dean

Branden Russell  
#9 Posted : Thursday, December 7, 2006 8:16:39 AM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

The DownLoader will create a symbol more than once as long as it isn't in the same folder. You can put them in different sub folders.

With the MetaStock Developer's Kit, you'd be able to read the security data files, but I don't beleive we sell the read/write version anymore so you wouldn't be able to create security files.

This is a problem everyone has that uses local data, that's why I came up with that utility. Hopefully I'll get approval and time to get it done to help you and all the others that need it.

longhair4277  
#10 Posted : Thursday, December 7, 2006 5:52:35 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

Will you be permitted to let us know if you have permission to work on this utility? As well, will you be able to give us an idea when you might be able to start on it?

Dean

Justin  
#11 Posted : Thursday, December 7, 2006 8:51:51 PM(UTC)
Justin

Rank: Advanced Member

Groups: Registered, Registered Users, Unverified Users
Joined: 9/13/2004(UTC)
Posts: 673
Location: Salt Lake City, UT

Generally speaking interest has to be gauged, development hours justified, support of this tool (if released, will it generate call volume, etc). I personally have been asking DataLink customers who call in whether they would be interested in such a tool and so far no one has said No...(I know it seems like a no-brainer, who wouldn't have such a handy tool but the above considerations are still valid). I believe that was the intent behind Branden's original forum post which did not generate much feedback.

Branden Russell  
#12 Posted : Friday, December 8, 2006 8:18:53 AM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

I'm not certain if I could tell you it has started, but I know I could never promise a release date.

Branden Russell  
#13 Posted : Thursday, December 14, 2006 3:24:36 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

I have been given permission to create this utility and post it on this forum as long as it is understood that it is not an Equis created, sponsored, or official utility.
Meaning, if I write it, Equis has no responsibility for it and I would provide it as is for you guys to use.
I would be providing this by myself, free of charge, and it comes with absolutely no support.
Are you guys still interested?

Also, I would probably only make it for version 10.0 and later, but may make it work with 9.2 and later.
PTJim  
#14 Posted : Thursday, December 14, 2006 6:06:51 PM(UTC)
PTJim

Rank: Advanced Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/10/2006(UTC)
Posts: 252

Thanks: 11 times
Was thanked: 9 time(s) in 6 post(s)
Thanks Branden, you're a gentleman and a scholar, not to mention a benefactor to humanity.

That being said, this MS9.1 user would appreciate compatibility as far back as is technically possible - especially since Equis wants to keep an arms-length distance from it, so there should be no issues about inhibiting upgrades or sales.

Branden Russell  
#15 Posted : Thursday, December 14, 2006 10:37:14 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

The only reason I would want to stop it at 9.2 is I changed how the symbol database worked in 9.2 and later versions so it would be a lot more work for me to do each version before 9.2, but all the versions after would be pretty easy. I'll get it done and maybe I'll throw in 9.1 just for you.
Branden Russell  
#16 Posted : Friday, December 15, 2006 1:22:37 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

Here is something I just threw together to show the options.
Let me know what you guys think. Is this going to be easy enough to figure out and use?
It doesn't do anything at all, so don't bother asking to try it yet:)

You find the location of your symbol database which will also let the program know which version you have.
Then you specify the location of the top folder of your securities files for the group you want to do.

Then select the Type (which fills in after specifying your database location) and desired Group (which fills in after selecting Type).

The Data start is when you want the data to start and is a drop down calendar that lets you easily choose day, month, and year.

Then the Interval lets you choose the interval of the securities to be created.

All that's left is you click the add button and it goes through the symbol database and compares it to the Local security file(s) location. It will then create folders and securities as needed for symbols that are in the symbol database, but not at the location.
It doesn't matter if you have a ton of securities there or none.

There will be two ways to delete unwanted securities at the local security file location. You can do it based on the number of days it has gone untraded or have it compared to the symbol database and delete anything at the specified location that doesn't exist in the current symbol database.

longhair4277  
#17 Posted : Friday, December 15, 2006 2:31:11 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

Looks great so far.... A couple things quickly come to mind

  1. Could you look at the collection report file (C:\Program Files\Equis he DownLoader\COLREPT.DAT) and rename existing securities from it? THe problem with the symbol database is that its only updated every 4-6 weeks. THis would keep current stocks accurate daily.
  2. By looking at the symbol database only, if some secuities have been added from a .SYM file, this method would delete them. Could an "auxilary" .SYM file be referenced as well to avoid this.
  3. Another "neet" feature would be to process a .SYM style file for bulk renaming of either the symbol itself or the name of the company

Thanks for the ear

Dean

Branden Russell  
#18 Posted : Friday, December 15, 2006 2:35:55 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

1) I could look into this, but not sure.

2) I should be able to add a check box to that delete option that also goes through all the SYM files in the same folder as the database.

3) You'll have to explain more on how you think that would work.

Branden Russell  
#19 Posted : Friday, December 15, 2006 2:41:45 PM(UTC)
Branden Russell

Rank: Advanced Member

Groups: Registered, Registered Users
Joined: 11/28/2005(UTC)
Posts: 276
Location: Salt Lake City, UT

I updated the above image with your second suggestion.
longhair4277  
#20 Posted : Friday, December 15, 2006 3:03:03 PM(UTC)
longhair4277

Rank: Member

Groups: Registered, Registered Users, Subscribers
Joined: 5/1/2006(UTC)
Posts: 26

3) You'll have to explain more on how you think that would work.

This feature would look at a special .SYM file that would contain lines of

ORIG-SYMBOL, NEW-SYMBOL, optional NEW-COMP-NAME

ORIG-SYMBOL - Used to lookup existing info in local dat

NEW-SYMBOL - New symbol for the company

NEW-COMP-NAME - Optional parameter, used if the symbol was staying the same, but name (as displayed in MS, was changing

If the XYllophone Zoo, symbol: XYZ was changing its name to "Marks Music Mart" the line for that would be

XYZ XYZ "Marks Music Mart"

If later the company decided to change its symbol to MMM, either your original design could do it, or the following could in ths special .SYM file:

XYZ MMM

As the name was not changing, it wouldn't be required

Basically what this feature would do, and some others I won't mention, would generally do, is do for "BULK" quantities of stocks is what the Downloader already does for single stocks. Make Sense?

Dean

Users browsing this topic
Guest (Hidden)
2 Pages12>
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.