Shell Script

Today I had to create a report from an online database.
Below is the script used. It took about 5 to 6 hours to process the 48766 records on the database using the SSH - Secure SHell.

The SSH Secure Shell for Workstations Windows client (SSH2 client) is a program that allows secure network services over an insecure network.

The SSH Secure Shell for Workstations Windows client replaces other, insecure terminal applications, such as Telnet and FTP. It allows you to securely remote login to remote host computers, to execute commands safely in a remote computer, and to provide secure encrypted and authenticated communications between two untrusted hosts. X11 connections and arbitrary TCP/IP ports can also be forwarded over the secure channel.

It is a powerful guardian against the numerous security hazards that nowadays threaten network communications.

Here the script

#! /bin/bash
HERE=/var/www/html/cfl/utils
HOST=dbms.m1group.com.au
ME=DBMS
TEMPLATE=template1
DATA=/var/www/html/cfl
SCRIPT=dbms_gen.sql
BPD_DATA=${DATA}/export
FLSD_DATA=${DATA}/export
C21_DATA=${DATA}/export
HS_DATA=${DATA}/export
TR_TO_CSV=${DATA}/utils/tr_to_csv.pl
#
#

cd ${HERE}
# Make BPD and HS reports
#
# Generate BPD and HS mail out files
${TR_TO_CSV} ${BPD_DATA}/BPD`date -I`_all.csv -a --c BPD
#${TR_TO_CSV} ${FLSD_DATA}/FLSD`date -I`_all2.csv -a --c FLSD
#${TR_TO_CSV} ${C21_DATA}/C21`date -I`_all2.csv -a --c C21
#
# 2005/01/28 not used anymore HS no longer customer
#${TR_TO_CSV} ${HS_DATA}/HS_`date -I`_all2.csv -a --c HS
#

Restore Your Computer's Performance with Windows XP

I've been downloading heaps of different software/applications for uni and personal use... My computer has been performing very slow.

I've had to fix the performance of it. The following link is a basic guide to "Restore Your Computer's Performance with Windows XP"

Downloading tools / plug-ins Task

I recently downloaded the Free Google Pack.
It's quite good had -

1. Google Deasktop - with handy tools for search your computer quicker and great for finding new google gadets that match your interests etc...
2. Google Toolbar for IE - Great pop-up block and it give you search acces with google from any webpages....
3. Mozilla Firefox with google Toolbar
4.Norton Security Scan
5. Picasa - Photo organizer/editor etc...
6. Google Screensaver
7. Adobe Reader 8
8. Spyware Doctor

Opitional Software

Realplayer, Skype and GalleryPlayer HD Images...

If you have already got some of the software, which most user will It will only update the software if a newer version is avaiable:)
You can also just choose the software you want...

Boolean & Google is my favorite

My favorite search engine is google. Why well basically it is recognized as the best general web search engine and from reading/surfing the net it's said to be the biggest sarch engine. Here's a UC Berkeley university link: -

http://www.lib.berkeley.edu/TeachingLib/Guides/Internet/Google.html

I recommend reading this link its quite good:)

Internet Relay Chat (IRC)

The main dfference I can see is IRC is group based not individual based?

Messenger

Been using Windows Messenger all week communicating with my former IT manager who is now based in China.

This has been great as I have needed information, advise and assistance from him in using certain application for work.

The following are some of the advantages this application has been for me: -

- Cost effective
- Able to view when he has been online
- Cut n paste SQL queries and similar commands (CentOs/Linux)for him to view and make adjustments if needed?
- Able to invite other related people to the conversations if needed

Test your web page according to the W3C standards by going to their ‘validator’ page

This page is not Valid HTML 4.01 Frameset!

Below are the results of attempting to parse this document with
an SGML parser.

1. 
   Error
   Line 4,
   column 29:
   required attribute "TYPE" not specified
   .
   

   <script language="javascript">

   
   
   
   
   

   
   The attribute given above is required for an element that you've used,
   but you have omitted it. For instance, in most HTML and XHTML document
   types the "type" attribute is required on the "script" element and the
   "alt" attribute is required for the "img" element.
   

   
   

   
   Typical values for type are
   type="text/css" for <style>
   and type="text/javascript" for <script>.
   

   
   
   
   

   
   href="feedback.html?uri=http%3A%2F%2Fwebct.curtin.edu.au%2F305033_a%2Fstudent_pres%2FGroup05%2Findex.html;errmsg_id=127#errormsg"
   title="Suggest improvements on this error message through our feedback channels"
   >✉
   

   
   
   



2. 
   Error
   Line 48,
   column 32:
   required attribute "TYPE" not specified
   .
   

   <script language="JavaScript1.4">

   
   
   
   
   

   
   href="feedback.html?uri=http%3A%2F%2Fwebct.curtin.edu.au%2F305033_a%2Fstudent_pres%2FGroup05%2Findex.html;errmsg_id=127#errormsg"
   title="Suggest improvements on this error message through our feedback channels"
   >✉
   

   
   
   



3. 
   Error
   Line 63,
   column 6:
   end tag for "HEAD" which is not finished
   .
   

   </head>

   
   
   
   
   

   
   Most likely, You nested tags and closed them in the wrong order. For
   example <p><em>...</p> is not acceptable, as <em>
   must be closed before <p>. Acceptable nesting is:
   <p><em>...</em></p>
   

   
   

   
   Another possibility is that you used an element which requires
   a child element that you did not include. Hence the parent element
   is "not finished", not complete. For instance, <head> generally
   requires a <title>, lists (ul, ol, dl) require list items (li,
   or dt, dd), and so on.
   

   
   
   
   

   
   href="feedback.html?uri=http%3A%2F%2Fwebct.curtin.edu.au%2F305033_a%2Fstudent_pres%2FGroup05%2Findex.html;errmsg_id=73#errormsg"
   title="Suggest improvements on this error message through our feedback channels"
   >✉
   

   
   
   



4. 
   Error
   Line 64,
   column 5:
   document type does not allow element "BODY" here
   .
   

   <body>

   
   
   
   
   

   
   The element named above was found in a context where it is not allowed.
   This could mean that you have incorrectly nested elements -- such as a
   "style" element in the "body" section instead of inside "head" -- or
   two elements that overlap (which is not allowed).
   

   
   

   
   One common cause for this error is the use of XHTML syntax in HTML
   documents. Due to HTML's rules of implicitly closed elements, this error
   can create cascading effects. For instance, using XHTML's "self-closing"
   tags for "meta" and "link" in the "head" section of a HTML document may
   cause the parser to infer the end of the "head" section and the
   beginning of the "body" section (where "link" and "meta" are not
   allowed; hence the reported error).
   

   
   
   
   

   
   href="feedback.html?uri=http%3A%2F%2Fwebct.curtin.edu.au%2F305033_a%2Fstudent_pres%2FGroup05%2Findex.html;errmsg_id=64#errormsg"
   title="Suggest improvements on this error message through our feedback channels"
   >✉
   

   
   
   



5. 
   Error
   Line 65,
   column 29:
   required attribute "TYPE" not specified
   .
   

   <script language="javascript">

   
   
   
   
   

   
   href="feedback.html?uri=http%3A%2F%2Fwebct.curtin.edu.au%2F305033_a%2Fstudent_pres%2FGroup05%2Findex.html;errmsg_id=127#errormsg"
   title="Suggest improvements on this error message through our feedback channels"
   >✉
   

   
   
   



6. 
   Error
   Line 70,
   column 6:
   end tag for "HTML" which is not finished
   .
   

   </html>

   
   
   
   
   

   
   href="feedback.html?uri=http%3A%2F%2Fwebct.curtin.edu.au%2F305033_a%2Fstudent_pres%2FGroup05%2Findex.html;errmsg_id=73#errormsg"
   title="Suggest improvements on this error message through our feedback channels"
   >✉
   

   
   
   

SSH Sercure Shell (SSH)

I'm currently using this application at work and finding it quite good.
As the name suggests the SSH Secure Shell for Workstations Windows client (SSH2 client) is a program that allows secure network services over an insecure network.

The SSH Secure Shell for Workstations Windows client replaces other, insecure terminal applications, such as Telnet and FTP. It allows you to securely remote login to remote host computers, to execute commands safely in a remote computer, and to provide secure encrypted and authenticated communications between two untrusted hosts. X11 connections and arbitrary TCP/IP ports can also be forwarded over the secure channel, expanding Secure Shell 2's usability even further.

Secure Shell 2 with its array of security features is a great tool for a network environment. It is a powerful guardian against the numerous security hazards that nowadays threaten network communications.

As a database administrator I have been using this application a far bit.

Tools for using the Web

Most of the tools suggested below I have played with at one time or another; -

• Adobe
• Media players
• Flash/Shockwave Players
• Search Manager/Combiners
• Bookmark Manager

etc...

I havent played around much with 'Offline Browser/copier' software. So I'm playing with WebCopier ™ 4.5 at the moment.

Played around with it. Found it very easy to user. I quite like the Tip by tip steps the WebCopier 4.5 offers. A useful tool for uni students or even web-developers. The following lists it's main features: -

-WebCopier for Windows is a multifunction offline browser designed to run under Windows 95/98/ME/NT/2000/XP.

-It is a powerful tool that copies websites and stores them locally, on your system, until you are ready to view them.

-Once you've copied a site, you have access to its information at any time, no matter where you are.

-You can take webpages (product literature, support information, etc.) on business trips and have instant access to them on your laptop -- no Internet connection required.

-Use WebCopier to copy entire websites, or only specific directories.

-WebCopier follows links precisely, including JavaScript parsing. It can download up to 100 files simultaneously.

-WebCopier can print entire websites or only specific part of them.

-Provides support for JavaScript (.js), Java Classes (.class) and Macromedia Flash (.swf) files.

-WebCopier supports proxy servers, and allows you to specify a user name and password to access secure websites.

-The File and URL Filters give you full control over which files are copied, and which are skipped.

-Use the Integrated browser to view the downloaded pages or to browse the Internet.

-WebCopier stores all paths in relative form, so files can be moved easily to another computer, CD, backup device.

-WebCopier is very easy to use

-Specially-designed Wizards will help you create each new download project.

SQL

I know this has nothing to do with NET11 but I thought I'd share that I scored 95% with my SQL test. Yay!!!

Contributing to the Infosphere: e-writing? - The Protocols

• The protocols (Taken from webct Curtin)

Over the years we have seen many changes since the early days of the www the protocols in use remain mostly the same as those proposed by Lee: -

• Http: hypertext transfer protocol is the communications protocol which enables requests to travel from your computer to the server on which the page /information you are requesting is held.
• Url: uniform resource locator – the address
• html: hypertext markup language– the language standard which ‘tells’ web browsers how to display the information
  

For more information see these definition (http://www.isgmlug.org/technology.html) and information on standard generalised markup language -http://www.isgmlug.org/sgmlhelp/exetwhy.htm (SGML).

Another language you might come across references to is ‘xml’: - ‘Short for Extensible Markup Language, a specification developed by the W3C. XML is a pared-down version of SGML, designed especially for Web documents. It allows designers to create their own customized tags, enabling the definition, transmission, validation, and interpretation of data between applications and between organizations.’

Contributing to the Infosphere: e-writing? - BACKGROUND

As I'm reading this topic I've already learnt that -

‘The first weblog was the first website, http://info.cern.ch/, the site built by Tim Berners-Lee at CERN.
From this page TBL pointed to all the new sites as they came online. Luckily, the content of this site has been archived at the World Wide Web Consortium… NCSA's What's New page took the cursor for a while, then Netscape's What's New page was the big blog in the sky in 1993-96. Then all hell broke loose. The Web exploded…

I'm currently visiting the info.cern.ch and already impressed with the intro statement -

"1990 was a momentous year in world events. In February, Nelson Mandela was freed after 27 years in prison. In April, the space shuttle Discovery carried the Hubble Space Telescope into orbit. And in October, Germany was reunified.Then at the end of 1990, a revolution took place that changed the way we live today."

I'm also checking out the following links http://www.boraski.com/www/hypertext.html & http://www.boraski.com/www/ht.html
It's worth checking out to see how things have changed over the years... I think you also get an in appreciation of this development too.

Here an interesting fact to note*

Hypertext, which most of us would associate with the WWW in fact predated the web – some would say by almost 50 years, if we take Vannevar Bush’s Memex as its theoretical starting point.

The term ‘hypertext’ was first described by Ted Nelson in 1965, who later went on to develop the Xanadu project. The first really successful hypertext system available to the public was the Apple computer HyperCard system.

In 1989 a group at CERN led by Tim Berners Lee began developing a protocol which would enable a world-wide hypertext system, this system became known as the WWW, and utilised html, http & urls. Berners Lee made the system available online for free in 1991. Shortly after, the first user friendly graphical browsers were developed with Mosaic appearing in 1993, and later, Netscape Navigator.

Internet Relay Chat (IRC)

I downloaded the software from mIRC PC . I must say this is alot more simple and user friendly, I think...

I didn't feel bombarded with heaps of information like I did on the ICQ site.

Very easy to read the instructions and follow them too. Very straight forward.
There's a saying "Sometimes less is more."

Chat - ICQ

I found the initial set-up of this particular application alittle bit frustrating at first. As you get bombarded with information overload - i.e. games, chat, forums, dating, products, more products, greetings blah blah blah...etc...

I tend to like my information, options short and sweet. I also guess anyone who would not be familiar with this form of online communication may feel the same??? So in order to feel confident in using ICQ you may want to make your-self familiar with the site too?

Anyway, ICQ as a form of communication (real-time text) is great, if and when the person (s) is there to communicate/chat with?

I sometimes use this form of communication to keep in contact, gain information with people overseas, as it's heaps cheaper then the phone.

Also being able to have, as an option, multiple, differing conversations occurring simultaneously can be very handy.

E-Mail Basics > 1: Addresses

This was really easy. I put the correct anwser in.
This is what appear anyway for anyone reading this: -

E-mail addresses always include

• the username (or account)
• as well as the domain name of the computer(s) that provide mail services.

How Routers Work???

Currently using 'Traceroute.' I saw just how many routers are involved in my Internet traffic by using a program I have on my computer. The program is called 'Traceroute,' -- it traced the route that the packet of information took to get from my computer to another computer connected to the Internet.

To run this program, I clicked on the "MS-DOS Prompt" icon on the "Start" menu. Then, at the "C:\WINDOWS>" prompt, type "tracert www.howstuffworks.com", as they suggested to try out.

• The first number shows how many routers are between my computer and the router shown.
• The next three numbers show how long it takes a packet of information to move from your computer to the router shown and back again.
• Next, starting with step six, comes the "name" of the router or server. (This is something that helps people looking at the list but is of no importance to the routers and computers as they move traffic along the Internet.)
• Finally, you see the Internet Protocol (IP) address of each computer or router.
• The final picture of the trace route shows the numbers routers between the Web server and me and the time it took, on average, for information to get from my computer to the server and back again.
  

File Transer Protocol (FTP)

In my day to day job as a 'Database Administrator' I use this application frequently. So learning more on using FTP is always a good thing.

I realise that using the file transfer protocol (FTP) is a crucial element of Internet use that, often, takes place 'in the background' behind what appears to be web browsing, as I sometimes need to move and store data.

File transfer protocol is a tool used to move files back and forth between computers in ways that are not about display (such as http) but about movement and storage.

The main use for FTP these days is when people are maintaining and changing websites.

Telnet

Telnet

I know.... I should have put this blog up awhile ago. But I've be very busy.....Sorry:)...

I did not know much regarding Telnet, so this module gave me a basic understanding regarding its histroy.

My understanding of the background of this application was that it was basically the first application to enable people at a location remote from a computer to log in directly to that computer, without actually being physically present with it, and being able to give that computer commands/instructions.

These days Telnet is not really used, but does still provide people with a very important capacity to treat distant computers as if they were 'on their desktop'.

These days anyone who has Internet access through an Internet Service Provider has a 'little bit' of the computer that serves the Internet to them (from the ISP) which is like their own computer.

I found this application somewhat interesting when I played around with it. Yes definitely a useful traditional information system for 'information seekers.' Anyway learning about this application gave me a useful insight and respect for 'Telnet.'

Today (help_desk)

I had an interesting month?

This last month I have had to transfer data from one database to another.
I found this somewhat difficult and frustrating as my knowledge of SQL scripting/ftp is very basic and what I know is basically stuff I have taught my-self.

The database I look after is controlled by pgAdmin (PostgreSQL), which is connected to the companies database server.

I wanting to create an sql script (select statement) to generate a report from different tables.
I know how to do this from one table but from multiple table I find it hard. I haven't really had much experience in this field. But I'm learning as I go...

Anyway I ended up copying and pasting the data into excel sheets as I found it easier!
I know it would have been heaps easier to have written a script but this was a quick solution until I get better a more confident in this area....

Learning Log

My name is Lee.
I'm currently studying NET11 at OUA. One day I hope to get a BA in Internet Studies.
I also work full time so and play music.

I'm studying part-time due to my other comittments... I wish I could studying full-time, but don't think it's a good idea.

This is a fairly late learning blog. But I hope to note my activities and what I'm learning in the course.

Cheers,

Lee:)